Skip to content

Mac_android microbenchmarks is 2.06% flaky #118692

Description

@fluttergithubbot

The post-submit test builder Mac_android microbenchmarks had a flaky ratio 2.06% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android%20microbenchmarks/8611
Commit: 13a8dce

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android%20microbenchmarks/8611
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android%20microbenchmarks/8579

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_android%20microbenchmarks

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Activity

  1. added
    engineflutter/engine related. See also e: labels.
    c: flakeTests that sometimes, but not always, incorrectly pass
    on Jan 18, 2023
  2. zanderso commented on Jan 18, 2023

    @zanderso
    Member

    In 8611, it looks like one of the microbenchmarks failed to generate the expected json result, but the logs don't indicate what went wrong.

    In 8579, the test timed-out after 30 minutes.

    Routing to the Android team for further investigation.

  3. removed their assignment
    on Jan 18, 2023
  4. added
    platform-androidAndroid applications specifically
    and removed
    engineflutter/engine related. See also e: labels.
    on Jan 18, 2023
  5. fluttergithubbot commented on Jan 25, 2023

    @fluttergithubbot
    ContributorAuthor

    [prod pool] current flaky ratio for the past (up to) 100 commits is 1.04%. Flaky number: 1; total number: 96.
    One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android%20microbenchmarks/8611
    Commit: 13a8dce
    Flaky builds:
    https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_android%20microbenchmarks/8611

    Recent test runs:
    https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_android%20microbenchmarks

  6. fluttergithubbot commented on Jan 25, 2023

    @fluttergithubbot
    ContributorAuthor

    [staging pool] current flaky ratio for the past (up to) 100 commits is 0.00%. Flaky number: 0; total number: 69.

  7. zanderso commented on Jan 25, 2023

    @zanderso
    Member

    Closing due to flake rate below the threshold.

  8. github-actions commented on Mar 4, 2023

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  9. locked as resolved and limited conversation to collaborators on Mar 4, 2023
  10. added
    P0Critical issues such as a build break or regression
    and removed on Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passplatform-androidAndroid applications specifically

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions