Skip to content

Windows_arm64 plugin_test_windows is 2.11% flaky #163122

Closed

Description

@fluttergithubbot

The post-submit test builder Windows_arm64 plugin_test_windows had a flaky ratio 2.11% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows_arm64%20plugin_test_windows/5178
Commit: 9438fd4

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows_arm64%20plugin_test_windows/5178
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows_arm64%20plugin_test_windows/5146

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Windows_arm64%20plugin_test_windows

Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

Activity

  1. added
    c: flakeTests that sometimes, but not always, incorrectly pass
    P0Critical issues such as a build break or regression
    on Feb 12, 2025
  2. ergosarapu commented on Feb 17, 2025

    @ergosarapu

    @loic-sharma Can you please check if this is caused by the Windows Defender issue mentioned in #145110?

  3. loic-sharma commented on Feb 18, 2025

    @loic-sharma
    Member

    @ergosarapu Unfortunately I only reduced the timeout as I was the gardener at that time, the Windows Defender identification was done by someone else.

    The test in question has been labeled as flaky, so it should no longer close the tree. I'll unassign myself as I don't have the time to investigate Windows Arm64 issue currently.

  4. removed their assignment
    on Feb 18, 2025
  5. added
    in triagePresently being triaged by the triage team
    team-infraOwned by Infrastructure team
    infra: auto flake botIssues with the bot that files flake issues
    and removed
    in triagePresently being triaged by the triage team
    on Feb 19, 2025
  6. ergosarapu commented on Feb 19, 2025

    @ergosarapu

    @keyonghan Is this something that you can help with? I noticed you were reviewer in an earlier issue.

  7. Piinks commented on Feb 25, 2025

    @Piinks
    Contributor

    Hey @ergosarapu keyonghan likely won't be working on this. They are on another team now.

  8. fluttergithubbot commented on Feb 26, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2025-02-12 and 2025-02-18 is 0.00%. Flaky number: 0; total number: 87.

  9. fluttergithubbot commented on Feb 26, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-02-19 and 2025-02-25 is 0.00%. Flaky number: 0; total number: 100.

  10. ergosarapu commented on Mar 4, 2025

    @ergosarapu

    The root cause of why flutter test command times out, stays unclear.

    Since it is not happening in staging, my suggestion is to remove bringup. If the timeout occurs again, someone with access to the bot could debug what is happening inside the bot.

  11. fluttergithubbot commented on Mar 5, 2025

    @fluttergithubbot
    ContributorAuthor

    [prod pool] flaky ratio for the past (up to) 100 commits between 2025-02-12 and 2025-02-18 is 0.00%. Flaky number: 0; total number: 77.

  12. fluttergithubbot commented on Mar 5, 2025

    @fluttergithubbot
    ContributorAuthor

    [staging pool] flaky ratio for the past (up to) 100 commits between 2025-02-27 and 2025-03-04 is 0.00%. Flaky number: 0; total number: 100.

  13. Piinks commented on Mar 5, 2025

    @Piinks
    Contributor

    The root cause of why flutter test command times out, stays unclear.

    Since it is not happening in staging, my suggestion is to remove bringup. If the timeout occurs again, someone with access to the bot could debug what is happening inside the bot.

    Thanks @ergosarapu! This is no longer on bringup, so I am going to close this issue and let the bot file a new one with details to investigate if it recurs. Thank you!

  14. github-actions commented on Mar 20, 2025

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  15. locked as resolved and limited conversation to collaborators on Mar 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passinfra: auto flake botIssues with the bot that files flake issuesteam-infraOwned by Infrastructure team

    Type

    No type

    Projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions