Repository navigation
Linux web_tool_tests is 2.06% flaky #169574
Description
The post-submit test builder Linux web_tool_tests had a flaky ratio 2.06% for the past (up to) 100 commits, which is above our 2.00% threshold.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23620
Commit: 4e75d56
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23620
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23577
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20web_tool_tests
Please follow https://github.com/flutter/flutter/blob/master/docs/infra/Reducing-Test-Flakiness.md#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).
Activity
jtmcdole commentedon May 28, 2025
Its now at 6%: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests?limit=100
jtmcdole commentedon May 28, 2025
Suspect: #169102
Attempt to roll forward a fix: #169607
@yjbanov @kevmoo fyi
jtmcdole commentedon May 29, 2025
Its now closer to 10%. This test needs to be moved to bring up.
matanlurey commentedon May 29, 2025
/cc @nshahan @kevmoo We are disabling this test as it's consistently bringing down the tree on
flutter_tools/test/web.shard/hot_restart_web_ddc_library_bundle_test.dart:https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests
#169716
Mark `Linux web_tool_tests` as `bringup` due to being 10%+ flaky (#16…
[DO NOT SUBMIT] Adding logs in DDC library bundle format to debug tim…
9 remaining items
fluttergithubbot commentedon Jun 11, 2025
[prod pool] flaky ratio for the past (up to) 100 commits between 2025-05-23 and 2025-05-29 is 3.26%. Flaky number: 3; total number: 92.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23643
Commit: a5b51db
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23643
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23620
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23577
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20web_tool_tests
fluttergithubbot commentedon Jun 11, 2025
[staging pool] flaky ratio for the past (up to) 100 commits between 2025-06-03 and 2025-06-10 is 7.00%. Flaky number: 7; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/151
Commit: 1b9502b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/81
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/78
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/71
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/151
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/139
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/130
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/118
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20web_tool_tests
Set max request pool size for DDC module loader when in CI
Set max request pool size for DDC module loader when in CI (#170565)
Include `showBringup=true` in Dashboard links (#4787)
fluttergithubbot commentedon Jun 18, 2025
[prod pool] flaky ratio for the past (up to) 100 commits between 2025-05-23 and 2025-05-29 is 3.33%. Flaky number: 3; total number: 90.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23643
Commit: a5b51db
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23643
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23620
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux%20web_tool_tests/23577
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20web_tool_tests
fluttergithubbot commentedon Jun 18, 2025
[staging pool] flaky ratio for the past (up to) 100 commits between 2025-06-10 and 2025-06-17 is 2.00%. Flaky number: 2; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/250
Commit: e5d2130
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/250
https://ci.chromium.org/ui/p/flutter/builders/staging/Linux%20web_tool_tests/247
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Linux%20web_tool_tests
srujzs commentedon Jun 18, 2025
The two flakes seem to be before #170565 landed so it seems like that PR likely has fixed the flakiness. I'll wait a few more days to get more info on the various bots, but we're probably ready to move this out of bringup.
mdebbar commentedon Jun 18, 2025
The
Linux web_tool_testsbot has been green for ~40 runs since #170565 🎉Un-bringup `Linux web_tool_tests` (#171004)
github-actions commentedon Jul 7, 2025
This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of
flutter doctor -vand a minimal reproduction of the issue.Un-bringup `Linux web_tool_tests` (flutter#171004)
Un-bringup `Linux web_tool_tests` (#171004)