Skip to content

Regression in average_cpu_usage mac_ios_post_backdrop_filter_perf_ios__timeline_summary #83113

Closed

Description

@kf6gpe

See https://flutter-flutter-perf.skia.org/e/?begin=1621526942&end=1621555092&keys=X004ec1c0b5dbc300448d8af0d4c8e889&num_commits=50&request_type=1&xbaroffset=24193.

It started around #83026, but I can't see how a plugins roll could have affected this benchmark. I'm going to start with giving it to the engine sheriff this week to bisect, but including the plugins team as well for triage.

/cc @chinmaygarde, this week's engine sheriff, and @stuartmorgan, ecosystem/plugins lead.

Activity

  1. added
    c: regressionIt was better in the past than it is now
    engineflutter/engine related. See also e: labels.
    c: performanceRelates to speed or footprint issues (see "perf:" labels)
    perf: speedPerformance issues related to (mostly rendering) speed
    P0Critical issues such as a build break or regression
    on May 21, 2021
  2. kf6gpe commented on May 21, 2021

    @kf6gpe
    ContributorAuthor

    Aha. I suspect it's not the plugin, but the engine; seeing similar regressions in average_cpu_usage mac_ios_new_gallery_ios__transition_perf around #83025.

    See
    https://flutter-flutter-perf.skia.org/e/?begin=1621494841&end=1621555092&keys=X91281eb0cabcec0938c76e6e8a17e9e4&num_commits=50&request_type=1&xbaroffset=24192

  3. aam commented on May 21, 2021

    @aam
    Member

    Yeah, that sounds plausible. We should be okay with regression given that we are getting better timelines, right?
    Until this PR we effectively could not tell how much actual CPU vs Wall time was spent on particular timeline event on iOS

  4. zanderso commented on May 22, 2021

    @zanderso
    Member

    @aam 15% CPU to query CPU time seems like a lot. Do you know if this is also what we see on other platforms?

    Either way we should also verify locally that it is that change. If @aam doesn't have a setup for that we can identify someone at the issue triage meeting on Monday.

  5. jason-simmons commented on May 22, 2021

    @jason-simmons
    Member

    Confirmed that reverting https://dart.googlesource.com/sdk.git/+/626b48090a3b6fdfa429666dc0e7646d1bde3a3b%5E%21/#F0 fixes the difference in average_cpu_usage on the mac_ios_simple_animation_perf_ios benchmark

  6. zanderso commented on May 24, 2021

    @zanderso
    Member

    We may need to accept this regression in order for the timelines from iOS to include this information. Dropping to P2 for @aam to confirm and compare overhead with Android and/or Linux.

  7. added and removed
    P0Critical issues such as a build break or regression
    on May 24, 2021
  8. aam commented on May 24, 2021

    @aam
    Member

    hmm, for some reason average_cpu_usage metric is not being extracted on android benchmarks

  9. aam commented on May 25, 2021

    @aam
    Member

    It looks like cpu_usage metric is very ios-specific https://github.com/flutter/engine/blob/master/shell/platform/darwin/ios/framework/Source/profiler_metrics_ios.mm#L173. I think it's hard to make apples-to-apples comparison between ios and android for this kind of calculation.

  10. zanderso commented on May 25, 2021

    @zanderso
    Member

    Yes, it looks like we don't track average CPU utilization on Android like we do on iOS. I think we'll have to chalk this up as the cost of the timeline in profile mode on iOS.

  11. github-actions commented on Aug 1, 2021

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  12. locked as resolved and limited conversation to collaborators on Aug 1, 2021
  13. added
    P0Critical issues such as a build break or regression
    and removed on Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P0Critical issues such as a build break or regressionc: performanceRelates to speed or footprint issues (see "perf:" labels)c: regressionIt was better in the past than it is nowdependency: dartDart team may need to help usengineflutter/engine related. See also e: labels.packageflutter/packages repository. See also p: labels.perf: speedPerformance issues related to (mostly rendering) speed

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions