Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable macro benchmark startup insights, update baseline profiles #235

Merged
merged 2 commits into from
Sep 19, 2024

Conversation

ychescale9
Copy link
Member

HomeFeedRecompositionBenchmark_homeFeedStateChange
FeedItem:%CardCount   min 10.0,   median 10.0,   max 10.0
FeedItem:%CardSumMs   min  2.1,   median  2.3,   max  5.6
FeedListCount         min  4.0,   median  4.0,   max  4.0
FeedListSumMs         min  0.2,   median  0.3,   max  0.3
SectionHeaderCount    min  4.0,   median  4.0,   max  4.0
SectionHeaderSumMs    min  0.0,   median  0.0,   max  0.1
frameCount            min 58.0,   median 61.0,   max 95.0
frameDurationCpuMs    P50   4.6,   P90   6.1,   P95   8.2,   P99  12.0
frameOverrunMs        P50  -8.3,   P90  -6.4,   P95  -5.6,   P99  -2.6
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

HomeFeedScrollingBenchmark_scrollHomeFeedCompilationBaselineProfiles
FeedItem:%CardCount   min  34.0,   median  36.0,   max  39.0
FeedItem:%CardSumMs   min  17.1,   median  18.0,   max  19.7
frameCount            min 440.0,   median 583.0,   max 609.0
frameDurationCpuMs    P50    7.0,   P90   11.6,   P95   13.9,   P99   15.9
frameOverrunMs        P50   -6.4,   P90   -0.4,   P95    1.1,   P99    2.8
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

HomeFeedScrollingBenchmark_scrollHomeFeedCompilationNone
FeedItem:%CardCount   min  32.0,   median  36.0,   max  38.0
FeedItem:%CardSumMs   min  19.1,   median  21.8,   max  27.0
frameCount            min 430.0,   median 591.0,   max 627.0
frameDurationCpuMs    P50    7.7,   P90   12.2,   P95   14.2,   P99   15.3
frameOverrunMs        P50   -5.7,   P90   -0.3,   P95    1.1,   P99    2.1
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

ScreenTransitionBenchmark_openAndCloseDetailsScreenKotlinYouTube
FeedItem:%CardCount   min   2.0,   median   2.0,   max   2.0
FeedItem:%CardSumMs   min   0.7,   median   0.8,   max   1.6
FeedListCount         min   1.0,   median   1.0,   max   1.0
FeedListSumMs         min   0.1,   median   0.1,   max   0.3
Screen:%Count         min   9.0,   median   9.0,   max   9.0
Screen:%SumMs         min   3.7,   median   4.3,   max   4.9
frameCount            min 149.0,   median 153.5,   max 220.0
frameDurationCpuMs    P50   10.0,   P90   27.4,   P95   29.7,   P99   37.4
frameOverrunMs        P50   -4.6,   P90   15.4,   P95   20.0,   P99   30.4
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

ScreenTransitionBenchmark_openAndCloseDetailsScreenTalkingKotlin
FeedItem:%CardCount   min  3.0,   median  3.0,   max  4.0
FeedItem:%CardSumMs   min  1.2,   median  1.5,   max  1.7
FeedListCount         min  1.0,   median  1.0,   max  1.0
FeedListSumMs         min  0.2,   median  0.2,   max  0.2
Screen:%Count         min  3.0,   median  3.0,   max  3.0
Screen:%SumMs         min  6.8,   median  9.2,   max 11.0
frameCount            min 68.0,   median 69.0,   max 72.0
frameDurationCpuMs    P50  11.5,   P90  28.3,   P95  29.1,   P99  31.2
frameOverrunMs        P50   1.7,   P90  19.3,   P95  23.6,   P99  27.2
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

ScreenTransitionBenchmark_openAndCloseDetailsScreenKotlinWeekly
FeedItem:%CardCount   min   3.0,   median   3.0,   max   4.0
FeedItem:%CardSumMs   min   1.2,   median   1.4,   max   2.1
FeedListCount         min   1.0,   median   1.0,   max   1.0
FeedListSumMs         min   0.2,   median   0.2,   max   0.3
Screen:%Count         min   3.0,   median   3.0,   max   3.0
Screen:%SumMs         min   2.2,   median   2.6,   max   3.1
frameCount            min  91.0,   median  98.0,   max 131.0
frameDurationCpuMs    P50   12.3,   P90   28.9,   P95   30.2,   P99   33.9
frameOverrunMs        P50    2.8,   P90   22.9,   P95   25.8,   P99   30.5
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

ScreenTransitionBenchmark_openAndCloseDetailsScreenKotlinBlog
FeedItem:%CardCount   min   3.0,   median   3.0,   max   4.0
FeedItem:%CardSumMs   min   1.0,   median   1.2,   max   3.4
FeedListCount         min   1.0,   median   1.0,   max   1.0
FeedListSumMs         min   0.1,   median   0.2,   max   0.2
Screen:%Count         min   9.0,   median   9.0,   max   9.0
Screen:%SumMs         min   3.5,   median   4.0,   max   5.1
frameCount            min 114.0,   median 138.0,   max 144.0
frameDurationCpuMs    P50   24.6,   P90   31.0,   P95   34.9,   P99   44.7
frameOverrunMs        P50   11.0,   P90   27.0,   P95   40.3,   P99   52.8
Traces: Iteration 0 1 2 3 4 5 6 7 8 9

StartupBenchmark_startupCompilationBaselineProfiles
├── Metrics
│   ├──   timeToFullDisplayMs      min 538.5,   median 553.5,   max 679.1
│   └──   timeToInitialDisplayMs   min 434.3,   median 450.8,   max 503.3
├── App Startup Insights
│   ├── Broadcast received count (expected: < 50 count)
│   │   └── seen in iterations: 0(86 count) 1(86 count) 2(86 count) 3(86 count) 4(86 count) 5(86 count) 6(78 count) 7(86 count) 8(86 count) 9(72 count)
│   ├── Main Thread - Binder transactions blocked (expected: false)
│   │   └── seen in iterations: 0(true)
│   └── installd running during launch (expected: false)
│       └── seen in iterations: 1(true)
└── Traces
    └── Iteration 0 1 2 3 4 5 6 7 8 9

StartupBenchmark_startupCompilationNone
├── Metrics
│   ├──   timeToFullDisplayMs      min 640.9,   median 681.5,   max 770.6
│   └──   timeToInitialDisplayMs   min 477.6,   median 490.3,   max 515.4
├── App Startup Insights
│   ├── No baseline or cloud profiles (expected: false)
│   │   └── seen in iterations: 0(true) 1(true) 2(true) 3(true) 4(true) 5(true) 6(true) 7(true) 8(true) 9(true)
│   ├── Broadcast received count (expected: < 50 count)
│   │   └── seen in iterations: 1(86 count) 2(86 count) 3(81 count) 4(86 count) 5(86 count) 6(78 count) 7(86 count) 8(86 count) 9(86 count)
│   └── Main Thread - Binder transactions blocked (expected: false)
│       └── seen in iterations: 8(true)
└── Traces
    └── Iteration 0 1 2 3 4 5 6 7 8 9

@ychescale9 ychescale9 merged commit b0949a6 into main Sep 19, 2024
5 checks passed
@ychescale9 ychescale9 deleted the yc/startup-insights branch September 19, 2024 08:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant