Skip to content

Mac_benchmark flutter_gallery_macos__compile is 2.15% flaky #160495

Closed

Description

@fluttergithubbot

The post-submit test builder Mac_benchmark flutter_gallery_macos__compile had a flaky ratio 2.15% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10740
Commit: 8631412

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10740
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10704

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_benchmark%20flutter_gallery_macos__compile

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Activity

  1. added
    c: flakeTests that sometimes, but not always, incorrectly pass
    P0Critical issues such as a build break or regression
    on Dec 18, 2024
  2. added
    P2Important issues not at the top of the work list
    and removed
    P0Critical issues such as a build break or regression
    on Jan 8, 2025
  3. removed their assignment
    on Jan 8, 2025
  4. fluttergithubbot commented on Jan 8, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2024-12-17 and 2025-01-07 is 1.08%. Flaky number: 1; total number: 93.
    One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819
    Commit: 09a585b
    Flaky builds:
    https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819

    Recent test runs:
    https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_benchmark%20flutter_gallery_macos__compile

  5. fluttergithubbot commented on Jan 15, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2024-12-19 and 2025-01-08 is 1.08%. Flaky number: 1; total number: 93.
    One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819
    Commit: 09a585b
    Flaky builds:
    https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819

    Recent test runs:
    https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_benchmark%20flutter_gallery_macos__compile

  6. fluttergithubbot commented on Jan 15, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-01-08 and 2025-01-14 is 0.00%. Flaky number: 0; total number: 98.

  7. fluttergithubbot commented on Jan 22, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2024-12-23 and 2025-01-08 is 1.79%. Flaky number: 1; total number: 56.
    One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819
    Commit: 09a585b
    Flaky builds:
    https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_benchmark%20flutter_gallery_macos__compile/10819

    Recent test runs:
    https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_benchmark%20flutter_gallery_macos__compile

  8. fluttergithubbot commented on Jan 22, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-01-10 and 2025-01-21 is 0.00%. Flaky number: 0; total number: 100.

  9. jmagman commented on Jan 22, 2025

    @jmagman
    Member

    No longer flaky, reverting bringup #162039

  10. fluttergithubbot commented on Jan 29, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2024-12-30 and 2025-01-08 is 0.00%. Flaky number: 0; total number: 41.

  11. fluttergithubbot commented on Jan 29, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-01-21 and 2025-01-28 is 0.00%. Flaky number: 0; total number: 100.

  12. fluttergithubbot commented on Feb 5, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2025-01-06 and 2025-01-08 is 0.00%. Flaky number: 0; total number: 33.

  13. fluttergithubbot commented on Feb 5, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-01-28 and 2025-02-04 is 0.00%. Flaky number: 0; total number: 100.

  14. fluttergithubbot commented on Feb 12, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-02-04 and 2025-02-11 is 0.00%. Flaky number: 0; total number: 100.

  15. github-actions commented on Feb 26, 2025

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  16. locked as resolved and limited conversation to collaborators on Feb 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issues not at the top of the work listc: flakeTests that sometimes, but not always, incorrectly passteam-macosOwned by the macOS platform team

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions