Skip to content

Mac_arm64_android run_release_test is 21.65% flaky #138076

Closed
Closed
Mac_arm64_android run_release_test is 21.65% flaky#138076
Labels
P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passteam-androidOwned by Android platform team

Description

@fluttergithubbot
fluttergithubbot
opened on Nov 8, 2023

The post-submit test builder Mac_arm64_android run_release_test had a flaky ratio 21.65% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9061
Commit: 8375dfd

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9061
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9056
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9055
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9053
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9052
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9051
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9049
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9048
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9047
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9046
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9045
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9044
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9043
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9036
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9035
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9033
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9031
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9030
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9029
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9026
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9025
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64_android%20run_release_test/9024

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_arm64_android%20run_release_test

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Activity

  1. fluttergithubbot
    added
    c: flakeTests that sometimes, but not always, incorrectly pass
    P0Critical issues such as a build break or regression
    team-toolOwned by Flutter Tool team
    on Nov 8, 2023
  2. fluttergithubbot
    assigned
    zanderso
    on Nov 8, 2023

  3. zanderso commented on Nov 8, 2023

    @zanderso
    zanderso
    on Nov 8, 2023
    Member

    Similar to #138061 cc @camsim99

  4. zanderso
    removed their assignment
    on Nov 8, 2023
  5. zanderso
    added
    team-androidOwned by Android platform team
    and removed
    team-toolOwned by Flutter Tool team
    on Nov 8, 2023

  6. camsim99 commented on Nov 9, 2023

    @camsim99
    camsim99
    on Nov 9, 2023
    Contributor

    Should be fixed by #138093

  7. camsim99
    closed this as completedon Nov 9, 2023

  8. github-actions commented on Nov 23, 2023

    @github-actions
    github-actionsbot
    on Nov 23, 2023 – with GitHub Actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  9. github-actions
    locked as resolved and limited conversation to collaborators on Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passteam-androidOwned by Android platform team

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions