Skip to content

[Fireperf][AASA] Additional experiments for _experiment_as_ttid#4283

Merged
leotianlizhan merged 11 commits intomasterfrom
experiment-ttid-2
Nov 8, 2022
Merged

[Fireperf][AASA] Additional experiments for _experiment_as_ttid#4283
leotianlizhan merged 11 commits intomasterfrom
experiment-ttid-2

Conversation

@leotianlizhan
Copy link
Contributor

@leotianlizhan leotianlizhan commented Nov 4, 2022

These experiments helps single out certain possibilities from the outliers we see in _experiment_as_ttid:

  1. SystemClock.uptimeMillis() is another monotonic timebase, but excluding deep sleep. This helps single out if the app was entering deep sleep thus causing massive duration
  2. OnPreDraw is what PRIMES uses for all of 1P Google, thus with lots of success. Just looking at onDraw there were many bugs and hoops the code has to deal with, and onPreDraw just looks more stable, so perhaps it can be a bug or something else there as well.

@google-oss-bot
Copy link
Collaborator

google-oss-bot commented Nov 4, 2022 •
edited
Loading

Coverage Report 1

Affected Products

  • firebase-perf

    Overall coverage changed from ? (31ab674) to 71.38% (0e1c382) by ?.

    103 individual files with coverage change

    FilenameBase (31ab674)Merge (0e1c382)Diff
    AddTrace.java?0.00%?
    AndroidApplicationInfo.java?34.71%?
    AndroidApplicationInfoOrBuilder.java?0.00%?
    AndroidLogger.java?100.00%?
    AndroidMemoryReading.java?38.36%?
    AndroidMemoryReadingOrBuilder.java?0.00%?
    ApplicationInfo.java?45.00%?
    ApplicationInfoOrBuilder.java?0.00%?
    ApplicationProcessState.java?73.91%?
    AppStartTrace.java?88.04%?
    AppStateMonitor.java?86.71%?
    AppStateUpdateHandler.java?92.86%?
    Clock.java?100.00%?
    ConfigResolver.java?93.19%?
    ConfigurationConstants.java?97.86%?
    ConfigurationFlag.java?100.00%?
    ConsoleUrlGenerator.java?37.50%?
    Constants.java?95.65%?
    Counter.java?90.91%?
    CpuGaugeCollector.java?92.77%?
    CpuMetricReading.java?39.33%?
    CpuMetricReadingOrBuilder.java?0.00%?
    DaggerFirebasePerformanceComponent.java?100.00%?
    DeviceCacheManager.java?76.03%?
    FirebasePerfApplicationInfoValidator.java?92.86%?
    FirebasePerfGaugeMetricValidator.java?100.00%?
    FirebasePerfHttpClient.java?93.85%?
    FirebasePerfMetricProto.java?0.00%?
    FirebasePerfNetworkValidator.java?86.67%?
    FirebasePerfOkHttpClient.java?44.90%?
    FirebasePerformance.java?79.12%?
    FirebasePerformanceAttributable.java?0.00%?
    FirebasePerformanceComponent.java?0.00%?
    FirebasePerformanceInitializer.java?33.33%?
    FirebasePerformanceModule.java?100.00%?
    FirebasePerformanceModule_ProvidesConfigResolverFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesFirebaseAppFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesFirebaseInstallationsFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesRemoteConfigComponentFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesRemoteConfigManagerFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesSessionManagerFactory.java?100.00%?
    FirebasePerformanceModule_ProvidesTransportFactoryProviderFactory.java?100.00%?
    FirebasePerformance_Factory.java?100.00%?
    FirebasePerfProvider.java?76.92%?
    FirebasePerfRegistrar.java?100.00%?
    FirebasePerfTraceValidator.java?85.87%?
    FirebasePerfUrlConnection.java?44.26%?
    FirstDrawDoneListener.java?85.19%?
    FlgTransport.java?83.33%?
    FragmentStateMonitor.java?94.87%?
    FrameMetricsCalculator.java?96.77%?
    FrameMetricsRecorder.java?76.32%?
    GaugeManager.java?98.41%?
    GaugeMetadata.java?26.17%?
    GaugeMetadataManager.java?77.78%?
    GaugeMetadataOrBuilder.java?0.00%?
    GaugeMetric.java?39.47%?
    GaugeMetricOrBuilder.java?0.00%?
    HttpMetric.java?92.65%?
    ImmutableBundle.java?100.00%?
    InstrHttpInputStream.java?92.86%?
    InstrHttpOutputStream.java?98.00%?
    InstrHttpsURLConnection.java?94.32%?
    InstrHttpURLConnection.java?93.42%?
    InstrumentApacheHttpResponseHandler.java?100.00%?
    InstrumentOkHttpEnqueueCallback.java?100.00%?
    InstrURLConnectionBase.java?94.86%?
    LogWrapper.java?23.08%?
    MemoryGaugeCollector.java?91.38%?
    NetworkConnectionInfo.java?0.00%?
    NetworkConnectionInfoOrBuilder.java?0.00%?
    NetworkRequestMetric.java?49.16%?
    NetworkRequestMetricBuilder.java?95.97%?
    NetworkRequestMetricBuilderUtil.java?75.00%?
    NetworkRequestMetricOrBuilder.java?0.00%?
    Optional.java?86.67%?
    PendingPerfEvent.java?100.00%?
    PerfMetric.java?33.67%?
    PerfMetricOrBuilder.java?0.00%?
    PerfMetricValidator.java?93.55%?
    PerfSession.java?93.22%?
    PerfSessionOrBuilder.java?0.00%?
    PreDrawListener.java?92.86%?
    Rate.java?100.00%?
    RateLimiter.java?90.77%?
    RemoteConfigManager.java?91.79%?
    ResourceType.java?0.00%?
    ScreenTraceUtil.java?94.12%?
    SessionAwareObject.java?0.00%?
    SessionManager.java?100.00%?
    SessionVerbosity.java?68.42%?
    StorageUnit.java?57.89%?
    Timer.java?92.11%?
    Trace.java?96.67%?
    TraceMetric.java?43.14%?
    TraceMetricBuilder.java?100.00%?
    TraceMetricOrBuilder.java?0.00%?
    TransportInfo.java?0.00%?
    TransportInfoOrBuilder.java?0.00%?
    TransportManager.java?94.88%?
    URLAllowlist.java?94.44%?
    URLWrapper.java?0.00%?
    Utils.java?78.57%?

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/okhpUnrrSl.html

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2022 •
edited
Loading

Unit Test Results

  51 files   -    344    51 suites   - 344   1m 31s ⏱️ - 17m 56s
974 tests  - 3 756  974 ✔️  - 3 734  0 💤  - 22  0 ❌ ±0 
974 runs   - 3 772  974 ✔️  - 3 750  0 💤  - 22  0 ❌ ±0 

Results for commit 164aa8b. ± Comparison against base commit 62cfd00.

♻️ This comment has been updated with latest results.

@google-oss-bot
Copy link
Collaborator

google-oss-bot commented Nov 4, 2022 •
edited
Loading

Size Report 1

Affected Products

  • firebase-perf

    TypeBase (31ab674)Merge (0e1c382)Diff
    aar311 kB313 kB+1.52 kB (+0.5%)
    apk (aggressive)1.03 MB1.03 MB+728 B (+0.1%)
    apk (release)2.47 MB2.48 MB+616 B (+0.0%)

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/nSR7b5JiHT.html

raymondlam
raymondlam reviewed Nov 7, 2022
View reviewed changes
@leotianlizhan leotianlizhan merged commit ff209d4 into master Nov 8, 2022
@leotianlizhan leotianlizhan deleted the experiment-ttid-2 branch November 8, 2022 23:09
davidmotson pushed a commit that referenced this pull request Nov 28, 2022
@leotianlizhan
[Fireperf][AASA] Additional experiments for _experiment_as_ttid (#4283
ce89393 
)

* predraw and uptimeMillis

* fix send event

* fix dangling variable and naming

* copyright

* fix test

* onStop

* test

* better readability

* comments

* reduce code

* reset
@firebase firebase locked and limited conversation to collaborators Dec 9, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@raymondlam raymondlam raymondlam approved these changes

@visumickey visumickey Awaiting requested review from visumickey

Assignees

No one assigned

Labels

no-changelog size/L

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@leotianlizhan @google-oss-bot @raymondlam