Skip to content

Flaky bot is not re-enabling some (?) bringup: true builds that are passing forever #166758

Closed
flutter/cocoon
#4553

Description

@matanlurey

For example, Windows plugin_test:

# excerpt from flutter/flutter/.ci.yaml

  - name: Windows plugin_test
    bringup: true # Flaky https://github.com/flutter/flutter/issues/148834
    recipe: devicelab/devicelab_drone
    timeout: 60

... was marked bringup: true with #148835, on May 2024.

The last 200 builds are green, but there does not appear to be any attempt to re-enable the tests.

Activity

  1. added
    infra: auto flake botIssues with the bot that files flake issues
    infra: cocoonRelated to the dashboard or cocoon server
    P2Important issues not at the top of the work list
    team-infraOwned by Infrastructure team
    triaged-infraTriaged by Infrastructure team
    on Apr 8, 2025
  2. added theissue type on Apr 8, 2025
  3. self-assigned this
    on Apr 8, 2025
  4. matanlurey commented on Apr 8, 2025

    @matanlurey
    ContributorAuthor

    The latest run looks like this:

    > INFO 2025-04-02T09:20:09.867Z The following builders are eligible to be marked no longer flaky: Linux_mokey android_engine_vulkan_tests Linux_android_emu external_textures_integration_test Mac_arm64_ios hot_mode_dev_cycle_ios_beta__benchmark Linux docs_deploy_beta Linux docs_deploy_stable

    ... which, for example, omits Windows plugin_test.

  5. matanlurey commented on Apr 9, 2025

    @matanlurey
    ContributorAuthor

    Here is the latest run with more logging:

    Possibly eligible flaky builders:
    Linux analyzer_benchmark
    Linux coverage
    Linux_mokey android_engine_vulkan_tests
    Linux_android_emu_unstable android_defines_test
    Linux_pixel_7pro android_semantics_integration_test
    Linux_android_emu external_textures_integration_test
    Linux_mokey hybrid_android_views_integration_test
    Linux_mokey new_gallery__crane_perf
    Staging_build_linux analyze
    Mac_mokey run_debug_test_android
    Mac_mokey run_release_test
    Mac_arm64_ios imitation_game_flutter
    Mac_arm64_ios imitation_game_swiftui
    Mac_ios microbenchmarks_ios
    Mac_arm64_ios hot_mode_dev_cycle_ios_beta__benchmark
    Windows plugin_test
    Windows_arm64 plugin_test_windows
    Linux flutter_packaging
    Windows flutter_packaging
    Linux docs_deploy_beta
    Linux docs_deploy_stable
    
    > DEBUG 2025-04-09T09:20:07.673Z Skipping Linux analyzer_benchmark, could not find matching builder line
    > DEBUG 2025-04-09T09:20:07.831Z Skipping Linux coverage, could not find matching builder line
    > DEBUG 2025-04-09T09:20:07.833Z Skipping Linux_android_emu_unstable android_defines_test, an existing PR is open: https://github.com/flutter/flutter/pull/165961
    > DEBUG 2025-04-09T09:20:07.989Z Skipping Linux_pixel_7pro android_semantics_integration_test, could not find matching builder line
    > DEBUG 2025-04-09T09:20:08.185Z Skipping Linux_mokey hybrid_android_views_integration_test, could not find matching builder line
    > DEBUG 2025-04-09T09:20:08.407Z Skipping Linux_mokey new_gallery__crane_perf, could not find matching builder line
    > DEBUG 2025-04-09T09:20:08.415Z Skipping Staging_build_linux analyze, ignore_flakiness specified
    > DEBUG 2025-04-09T09:20:08.610Z Skipping Mac_mokey run_debug_test_android, could not find matching builder line
    > DEBUG 2025-04-09T09:20:08.792Z Skipping Mac_mokey run_release_test, could not find matching builder line
    > DEBUG 2025-04-09T09:20:08.793Z Skipping Mac_arm64_ios imitation_game_flutter, an existing PR is open: https://github.com/flutter/flutter/pull/163113
    > DEBUG 2025-04-09T09:20:08.793Z Skipping Mac_arm64_ios imitation_game_swiftui, an existing PR is open: https://github.com/flutter/flutter/pull/163114
    > DEBUG 2025-04-09T09:20:09.008Z Skipping Windows plugin_test, could not find matching builder line
    > DEBUG 2025-04-09T09:20:09.219Z Skipping Windows_arm64 plugin_test_windows, could not find matching builder line
    > DEBUG 2025-04-09T09:20:09.219Z Skipping Linux flutter_packaging, could not find matching builder line
    > DEBUG 2025-04-09T09:20:09.221Z Skipping Windows flutter_packaging, could not find matching builder line
    
  6. matanlurey commented on Apr 19, 2025

    @matanlurey
    ContributorAuthor

    Skipping Windows plugin_test, issue #2310041852 (flutter/flutter) is reporting as non-closed state: closed ???

  7. matanlurey commented on Apr 19, 2025

    @matanlurey
    ContributorAuthor
    Image

    Fuck it's package:github being super outdated all over again.

  8. github-actions commented on May 3, 2025

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  9. locked as resolved and limited conversation to collaborators on May 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P2Important issues not at the top of the work listinfra: auto flake botIssues with the bot that files flake issuesinfra: cocoonRelated to the dashboard or cocoon serverteam-infraOwned by Infrastructure teamtriaged-infraTriaged by Infrastructure team

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions