Skip to content

Fix benchmark test failures erroneously passing on CI - #9403

Merged
elliette merged 6 commits into
flutter:masterfrom
elliette:issue-9397
Oct 14, 2025
Merged

elliette merged 6 commits into
flutter:masterfrom
elliette:issue-9397

Conversation

@elliette

@elliette elliette commented Aug 19, 2025 •

Copy link
Copy Markdown
Member

Work towards #9397

Unfortunately it will be impossible to verify if this fixed the issue of our benchmark tests erroneously passing on CI because we are only seeing that behavior on commits to the master branch, and not to commits to an open PR.

My best guess here is that the redundant -j arg (with invalid ,) value is causing issues here. -j is the short name for the --concurrency flag. Note: I'm guessing this was simply a copy-paste error when copying the flag from flutter test --help:

-j, --concurrency=<jobs> The number of concurrent test processes to run. This will be ignored when running integration tests.

@elliette elliette changed the title Benchmark test failures don't appear in CI [DRAFT] Benchmark test failures don't appear in CI Sep 15, 2025
@elliette elliette changed the title [DRAFT] Benchmark test failures don't appear in CI Fix benchmark test failures erroneously passing on CI Oct 14, 2025
@elliette
elliette marked this pull request as ready for review October 14, 2025 20:33
@elliette
elliette requested review from srawlins and removed request for kenzieschmoll October 14, 2025 20:42
@elliette
elliette merged commit 38116d8 into flutter:master Oct 14, 2025
34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants