Windows tool_integration_tests_2_6 flakes on deferred_components_test

(part of #97036)

Two flakes in recent 100 runs.

https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/845/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/756/overview

14:25 +37 -1: test\integration.shard\deferred_components_test.dart: simple build appbundle mismatched golden no-validate-deferred-components succeeds [E]                                              
  Expected: <true>
    Actual: <false>
  
  package:test_api                                            expect
  test\integration.shard\deferred_components_test.dart 165:5  main.<fn>

@GaryQian

@GaryQian could you please triage this following https://github.com/flutter/flutter/wiki/Issue-hygiene#flaky-tests.

@GaryQian

@GaryQian have you had a chance to take a look at this one?

Not yet, ill look at it today.

Not yet, ill look at it today.

Thanks!

I have so far been unable to repro, and the test seems to have stabilized, remaining green for about 100 runs

I'll continue to observe its stability.

Another instance today: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/955/overview

@GaryQian

Another instance today: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/955/overview

@GaryQian looks like this is stlil happening

@GaryQian

@GaryQian were you able to take a look at this one?

Looking now

Looking now

Thanks!

#103161 Adds temporary logging. More info is needed to deflake this.

Thanks for working on this!

Another two same instances:
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1272/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1276/overview

There is another flake on deferred_components_test: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1252/overview

12:15 +35 -1: test\integration.shard\deferred_components_test.dart: simple build appbundle all targets succeeds [E]                                                                                    
  Expected: contains 'app-release.aab'
    Actual: 'Deferred components prebuild validation passed.\n'
              '\n'
              ' Building with sound null safety \n'
              '\n'
              'Running Gradle task \'bundleRelease\'...                          \n'
              'Shrinking has been disabled for this build due to deferred components. Shrinking is not available for multi-apk applications. This limitation is expected to be removed when Gradle plugin 4.2+ is available in Flutter.\n'
              'Running Gradle task \'bundleRelease\'...                             10.6s\n'
              ''
  
  package:test_api                                           expect
  test\integration.shard\deferred_components_test.dart 75:5  main.<fn>

Here's a build that is I believe post Gary's logging change, although I don't see more logging: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1276/overview

@GaryQian

Here's a build that is I believe post Gary's logging change, although I don't see more logging: https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1276/overview

@GaryQian any update on this one?

Not a solution, but the test has not flaked for ~400+ runs, last failure was https://ci.chromium.org/ui/p/flutter/builders/prod/Windows%20tool_integration_tests_2_6/1386/overview on May 11th.

Even so, the previous failures seem to happen across multiple variants of the test and are quite varied in cause.

@keyonghan

In the last 400 commits, I count 1 flakes and 2 failures for this builder, which would be under the threshold.

@keyonghan am I reading this correctly?

I'm going to close this one since we aren't seeing it very much any more, but feel free to reopen if you have any idea what's causing it or if it starts happening more often...

This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

Navigation Menu

Repository navigation

Windows tool_integration_tests_2_6 flakes on `deferred_components_test` #101609

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Windows tool_integration_tests_2_6 flakes on deferred_components_test #101609

Description

Activity

zanderso commented on Apr 8, 2022

christopherfujino commented on Apr 12, 2022

GaryQian commented on Apr 12, 2022

christopherfujino commented on Apr 12, 2022

GaryQian commented on Apr 14, 2022

keyonghan commented on Apr 15, 2022

christopherfujino commented on Apr 26, 2022

christopherfujino commented on May 3, 2022

GaryQian commented on May 3, 2022

christopherfujino commented on May 3, 2022

GaryQian commented on May 5, 2022

keyonghan commented on May 6, 2022

christopherfujino commented on May 10, 2022

christopherfujino commented on May 17, 2022

GaryQian commented on May 25, 2022

GaryQian commented on May 25, 2022

christopherfujino commented on May 31, 2022

Hixie commented on May 31, 2022

github-actions commented on Jun 15, 2022

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions

Windows tool_integration_tests_2_6 flakes on `deferred_components_test` #101609