Mac_arm64 tool_tests_commands is 3.03% flaky #189849

Activity

1. fluttergithubbot

   assigned

   bkonyi

   on Jul 22, 2026
2. fluttergithubbot

   added

   P0Critical issues such as a build break or regressionCritical issues such as a build break or regression

   c: flakeTests that sometimes, but not always, incorrectly passTests that sometimes, but not always, incorrectly pass

   team-toolOwned by Flutter Tool teamOwned by Flutter Tool team

   on Jul 22, 2026
3. Piinks commented on Jul 27, 2026

   

   Piinks

   on Jul 27, 2026

   Contributor

   More actions

   Most of these are:

   Failing tests:
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade Doesn't throw on known tag, beta branch, no force
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade does not throw on unknown tag, official branch, force
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade does not throw tool exit with uncommitted changes and force
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/permeable/upgrade_test.dart: UpgradeCommandRunner runs upgrade full command upgrade continue prints welcome message
   

   One of these:

   Failing tests:
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_test.dart: PreviewDetector can detect changes in the pubspec.yaml
   

   And one of these:

   Failing tests:
     /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_workspace_test.dart: PreviewDetector - Workspace can detect changes in a subproject's pubspec.yaml
   
4. Piinks commented on Aug 3, 2026

   

   Piinks

   on Aug 3, 2026

   Contributor

   More actions

   Waiting on the bot to report back this Wednesday.
5. fluttergithubbot commented on Aug 5, 2026

   

   fluttergithubbot

   on Aug 5, 2026

   ContributorAuthor

   More actions

   [prod pool] flaky ratio for the past (up to) 100 commits between 2026-07-29 and 2026-08-04 is 0.00%. Flaky number: 0; total number: 99.
6. Piinks commented on Aug 10, 2026

   

   Piinks

   on Aug 10, 2026

   Contributor

   More actions

   Looks like this is better
7. bkonyi

   added

   triaged-toolTriaged by Flutter Tool teamTriaged by Flutter Tool team

   on Aug 11, 2026
8. fluttergithubbot commented on Aug 12, 2026

   

   fluttergithubbot

   on Aug 12, 2026

   ContributorAuthor

   More actions

   [prod pool] flaky ratio for the past (up to) 100 commits between 2026-08-05 and 2026-08-11 is 1.01%. Flaky number: 1; total number: 99.
   One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13814
   Commit: 1cd7c6b
   Flaky builds:
   https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_arm64%20tool_tests_commands/13814

   Recent test runs:
   https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_arm64%20tool_tests_commands
9. jtmcdole commented on Aug 12, 2026

   

   jtmcdole

   on Aug 12, 2026

   Last edited by jtmcdole

   Member

   More actions

   I see two "Command exited with exit code 1 but expected zero exit code." in the last 100 post submits.

    25:46 +908 ~4 -1: /Volumes/Work/s/w/ir/x/w/flutter/packages/flutter_tools/test/commands.shard/hermetic/widget_preview/preview_detector/preview_detector_test.dart: PreviewDetector can detect changes in the pubspec.yaml [E]
      TimeoutException after 0:15:00.000000: Test timed out after 15 minutes.
      dart:isolate  _RawReceivePort._handleMessage
   
10. fluttergithubbot commented on Aug 19, 2026

    

    fluttergithubbot

    on Aug 19, 2026

    ContributorAuthor

    More actions

    [prod pool] flaky ratio for the past (up to) 100 commits between 2026-08-12 and 2026-08-18 is 0.00%. Flaky number: 0; total number: 100.
11. Piinks commented on Aug 24, 2026

    

    Piinks

    on Aug 24, 2026

    Contributor

    More actions

    Looks like there is a PR out, and even better, we are not seeing flakes last week.
12. auto-submit

    closed this as completedin #191214on Aug 25, 2026
13. LouiseHsu

    added a commit that references this issue on Aug 25, 2026

    [flutter_tools] Resolve symlinks and fix flakiness in widget preview …

    ...

    3700590
14. github-actions commented on Sep 8, 2026

    

    github-actionsbot

    on Sep 8, 2026 – with GitHub Actions

    More actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.
15. github-actions

    locked as resolved and limited conversation to collaborators on Sep 8, 2026