Skip to content

Use a fake stopwatch to remove flakiness. - #133229

Merged
Hixie merged 1 commit into
flutter:masterfrom
Hixie:toolflake
Aug 29, 2023
Merged

Hixie merged 1 commit into
flutter:masterfrom
Hixie:toolflake

Conversation

@Hixie

@Hixie Hixie commented Aug 24, 2023

Copy link
Copy Markdown
Contributor

Fixes #133215

@github-actions github-actions Bot added the tool Affects the "flutter" command-line tool. See also t: labels. label Aug 24, 2023
@Hixie

Hixie commented Aug 24, 2023

Copy link
Copy Markdown
Contributor Author

cc @flar

@christopherfujino

Copy link
Copy Markdown
Contributor

you beat me to it

@christopherfujino christopherfujino left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@flar

flar commented Aug 24, 2023

Copy link
Copy Markdown
Contributor

I'm not sure what the fake stopwatch is, so I can't really evaluate this. Since the success metric on the original test case seemed to be its timing output, it sounds like the fake stopwatch might fake the success metric itself?

@christopherfujino

Copy link
Copy Markdown
Contributor

I'm not sure what the fake stopwatch is, so I can't really evaluate this. Since the success metric on the original test case seemed to be its timing output, it sounds like the fake stopwatch might fake the success metric itself?

Really what we care about here is that there are no spinner animation characters

@Hixie Hixie added the autosubmit Merge PR when tree becomes green via auto submit App label Aug 24, 2023
@auto-submit auto-submit Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Aug 24, 2023
@auto-submit

auto-submit Bot commented Aug 24, 2023

Copy link
Copy Markdown
Contributor

auto label is removed for flutter/flutter/133229, due to - The status or check suite Google testing has failed. Please fix the issues identified (or deflake) before re-applying this label.

@Hixie Hixie added the autosubmit Merge PR when tree becomes green via auto submit App label Aug 25, 2023
@auto-submit

auto-submit Bot commented Aug 25, 2023

Copy link
Copy Markdown
Contributor

auto label is removed for flutter/flutter/133229, due to - The status or check suite Google testing has failed. Please fix the issues identified (or deflake) before re-applying this label.

@auto-submit auto-submit Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Aug 25, 2023
@Hixie Hixie added the autosubmit Merge PR when tree becomes green via auto submit App label Aug 25, 2023
@Hixie

Hixie commented Aug 25, 2023

Copy link
Copy Markdown
Contributor Author

I swear I've run into more flakes (mostly around the Google testing shard) trying to fix this flake than this flake itself has ever caused! 😅

@auto-submit

auto-submit Bot commented Aug 25, 2023

Copy link
Copy Markdown
Contributor

auto label is removed for flutter/flutter/133229, due to - The status or check suite Google testing has failed. Please fix the issues identified (or deflake) before re-applying this label.

@auto-submit auto-submit Bot removed the autosubmit Merge PR when tree becomes green via auto submit App label Aug 25, 2023
@Hixie Hixie added the autosubmit Merge PR when tree becomes green via auto submit App label Aug 29, 2023
@Hixie
Hixie merged commit 89310ed into flutter:master Aug 29, 2023
@Hixie

Hixie commented Aug 29, 2023

Copy link
Copy Markdown
Contributor Author

manually merging on red because the red is false red.

@Hixie
Hixie deleted the toolflake branch August 29, 2023 19:49
engine-flutter-autoroll added a commit to engine-flutter-autoroll/packages that referenced this pull request Aug 30, 2023
auto-submit Bot pushed a commit to flutter/packages that referenced this pull request Aug 30, 2023
flutter/flutter@6c95737...1fe2495

2023-08-30 [email protected] Update SelectableRegion test for M3 (flutter/flutter#129627)
2023-08-30 [email protected] Remove cirrus tests from the flutter framework. (flutter/flutter#133575)
2023-08-30 [email protected] Roll Flutter Engine from 749e67a947bc to 69f04bdfe952 (2 revisions) (flutter/flutter#133621)
2023-08-30 [email protected] [flutter roll] Revert "Fix `Chip.shape`'s side is not used when provided in Material 3" (flutter/flutter#133615)
2023-08-30 [email protected] Roll Flutter Engine from 9f2cf5c99b0f to 749e67a947bc (2 revisions) (flutter/flutter#133618)
2023-08-30 [email protected] Roll Flutter Engine from c5854a6b3658 to 9f2cf5c99b0f (4 revisions) (flutter/flutter#133616)
2023-08-30 [email protected] No longer include `.packages` in created `.gitignore` files (flutter/flutter#133484)
2023-08-30 [email protected] Roll Flutter Engine from db3ecf8b2739 to c5854a6b3658 (1 revision) (flutter/flutter#133610)
2023-08-29 [email protected] Roll Flutter Engine from 1feb9302050c to db3ecf8b2739 (4 revisions) (flutter/flutter#133609)
2023-08-29 [email protected] Fix one notDisposed leak and mark another. (flutter/flutter#133595)
2023-08-29 [email protected] Roll Flutter Engine from 01a1579808b5 to 1feb9302050c (1 revision) (flutter/flutter#133604)
2023-08-29 [email protected] Upgrade packages. (flutter/flutter#133593)
2023-08-29 [email protected] Cover more tests with leak tracking. (flutter/flutter#133596)
2023-08-29 [email protected] Roll Flutter Engine from 73cc3fb451fd to 01a1579808b5 (3 revisions) (flutter/flutter#133591)
2023-08-29 [email protected] Added DropdownMenuEntry.labelWidget (flutter/flutter#133491)
2023-08-29 [email protected] Use a fake stopwatch to remove flakiness. (flutter/flutter#133229)
2023-08-29 [email protected] Roll Flutter Engine from d1e6eb080f08 to 73cc3fb451fd (3 revisions) (flutter/flutter#133580)
2023-08-29 [email protected] [web] Migrate remaining web-only API usages to `dart:ui_web` (flutter/flutter#132248)
2023-08-29 [email protected] Add doxygen doc generation. (flutter/flutter#131356)
2023-08-29 [email protected] Roll Flutter Engine from 50bd80773287 to d1e6eb080f08 (2 revisions) (flutter/flutter#133570)
2023-08-29 [email protected] ShortcutManager should dispatch creation in constructor. (flutter/flutter#133487)
2023-08-29 [email protected] Add FAB Additional Color Mappings example (flutter/flutter#133453)
2023-08-29 [email protected] Roll Flutter Engine from 65438c7bb46a to 50bd80773287 (1 revision) (flutter/flutter#133565)
2023-08-29 [email protected] Roll Packages from 383bffa to d7d3150 (13 revisions) (flutter/flutter#133564)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages
Please CC [email protected],[email protected] on the revert to ensure that a human
is aware of the problem.

To file a bug in Packages: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
engine-flutter-autoroll added a commit to engine-flutter-autoroll/packages that referenced this pull request Nov 15, 2023
creatorpiyush pushed a commit to creatorpiyush/packages that referenced this pull request Jun 10, 2026
flutter/flutter@6c95737...1fe2495

2023-08-30 [email protected] Update SelectableRegion test for M3 (flutter/flutter#129627)
2023-08-30 [email protected] Remove cirrus tests from the flutter framework. (flutter/flutter#133575)
2023-08-30 [email protected] Roll Flutter Engine from 749e67a947bc to 69f04bdfe952 (2 revisions) (flutter/flutter#133621)
2023-08-30 [email protected] [flutter roll] Revert "Fix `Chip.shape`'s side is not used when provided in Material 3" (flutter/flutter#133615)
2023-08-30 [email protected] Roll Flutter Engine from 9f2cf5c99b0f to 749e67a947bc (2 revisions) (flutter/flutter#133618)
2023-08-30 [email protected] Roll Flutter Engine from c5854a6b3658 to 9f2cf5c99b0f (4 revisions) (flutter/flutter#133616)
2023-08-30 [email protected] No longer include `.packages` in created `.gitignore` files (flutter/flutter#133484)
2023-08-30 [email protected] Roll Flutter Engine from db3ecf8b2739 to c5854a6b3658 (1 revision) (flutter/flutter#133610)
2023-08-29 [email protected] Roll Flutter Engine from 1feb9302050c to db3ecf8b2739 (4 revisions) (flutter/flutter#133609)
2023-08-29 [email protected] Fix one notDisposed leak and mark another. (flutter/flutter#133595)
2023-08-29 [email protected] Roll Flutter Engine from 01a1579808b5 to 1feb9302050c (1 revision) (flutter/flutter#133604)
2023-08-29 [email protected] Upgrade packages. (flutter/flutter#133593)
2023-08-29 [email protected] Cover more tests with leak tracking. (flutter/flutter#133596)
2023-08-29 [email protected] Roll Flutter Engine from 73cc3fb451fd to 01a1579808b5 (3 revisions) (flutter/flutter#133591)
2023-08-29 [email protected] Added DropdownMenuEntry.labelWidget (flutter/flutter#133491)
2023-08-29 [email protected] Use a fake stopwatch to remove flakiness. (flutter/flutter#133229)
2023-08-29 [email protected] Roll Flutter Engine from d1e6eb080f08 to 73cc3fb451fd (3 revisions) (flutter/flutter#133580)
2023-08-29 [email protected] [web] Migrate remaining web-only API usages to `dart:ui_web` (flutter/flutter#132248)
2023-08-29 [email protected] Add doxygen doc generation. (flutter/flutter#131356)
2023-08-29 [email protected] Roll Flutter Engine from 50bd80773287 to d1e6eb080f08 (2 revisions) (flutter/flutter#133570)
2023-08-29 [email protected] ShortcutManager should dispatch creation in constructor. (flutter/flutter#133487)
2023-08-29 [email protected] Add FAB Additional Color Mappings example (flutter/flutter#133453)
2023-08-29 [email protected] Roll Flutter Engine from 65438c7bb46a to 50bd80773287 (1 revision) (flutter/flutter#133565)
2023-08-29 [email protected] Roll Packages from 383bffa to d7d3150 (13 revisions) (flutter/flutter#133564)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages
Please CC [email protected],[email protected] on the revert to ensure that a human
is aware of the problem.

To file a bug in Packages: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
bisor0627 pushed a commit to bisor0627/packages that referenced this pull request Jun 19, 2026
flutter/flutter@6c95737...1fe2495

2023-08-30 [email protected] Update SelectableRegion test for M3 (flutter/flutter#129627)
2023-08-30 [email protected] Remove cirrus tests from the flutter framework. (flutter/flutter#133575)
2023-08-30 [email protected] Roll Flutter Engine from 749e67a947bc to 69f04bdfe952 (2 revisions) (flutter/flutter#133621)
2023-08-30 [email protected] [flutter roll] Revert "Fix `Chip.shape`'s side is not used when provided in Material 3" (flutter/flutter#133615)
2023-08-30 [email protected] Roll Flutter Engine from 9f2cf5c99b0f to 749e67a947bc (2 revisions) (flutter/flutter#133618)
2023-08-30 [email protected] Roll Flutter Engine from c5854a6b3658 to 9f2cf5c99b0f (4 revisions) (flutter/flutter#133616)
2023-08-30 [email protected] No longer include `.packages` in created `.gitignore` files (flutter/flutter#133484)
2023-08-30 [email protected] Roll Flutter Engine from db3ecf8b2739 to c5854a6b3658 (1 revision) (flutter/flutter#133610)
2023-08-29 [email protected] Roll Flutter Engine from 1feb9302050c to db3ecf8b2739 (4 revisions) (flutter/flutter#133609)
2023-08-29 [email protected] Fix one notDisposed leak and mark another. (flutter/flutter#133595)
2023-08-29 [email protected] Roll Flutter Engine from 01a1579808b5 to 1feb9302050c (1 revision) (flutter/flutter#133604)
2023-08-29 [email protected] Upgrade packages. (flutter/flutter#133593)
2023-08-29 [email protected] Cover more tests with leak tracking. (flutter/flutter#133596)
2023-08-29 [email protected] Roll Flutter Engine from 73cc3fb451fd to 01a1579808b5 (3 revisions) (flutter/flutter#133591)
2023-08-29 [email protected] Added DropdownMenuEntry.labelWidget (flutter/flutter#133491)
2023-08-29 [email protected] Use a fake stopwatch to remove flakiness. (flutter/flutter#133229)
2023-08-29 [email protected] Roll Flutter Engine from d1e6eb080f08 to 73cc3fb451fd (3 revisions) (flutter/flutter#133580)
2023-08-29 [email protected] [web] Migrate remaining web-only API usages to `dart:ui_web` (flutter/flutter#132248)
2023-08-29 [email protected] Add doxygen doc generation. (flutter/flutter#131356)
2023-08-29 [email protected] Roll Flutter Engine from 50bd80773287 to d1e6eb080f08 (2 revisions) (flutter/flutter#133570)
2023-08-29 [email protected] ShortcutManager should dispatch creation in constructor. (flutter/flutter#133487)
2023-08-29 [email protected] Add FAB Additional Color Mappings example (flutter/flutter#133453)
2023-08-29 [email protected] Roll Flutter Engine from 65438c7bb46a to 50bd80773287 (1 revision) (flutter/flutter#133565)
2023-08-29 [email protected] Roll Packages from abdcaab to e39dd4b (13 revisions) (flutter/flutter#133564)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages
Please CC [email protected],[email protected] on the revert to ensure that a human
is aware of the problem.

To file a bug in Packages: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

autosubmit Merge PR when tree becomes green via auto submit App tool Affects the "flutter" command-line tool. See also t: labels.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Test fails based on time taken rather than testing the actual condition

3 participants