Skip to content

Move devicelab benchmark builders from staging to prod #105468

Closed

Description

@keyonghan

Devicelab benchmark builders are https://ci.chromium.org/p/flutter/g/devicelab_benchmark/console.

These builders were moved to staging due to their high flaky rate. As of today, linux/android ones have been pretty stable without a single flak in recent 500 runs, and we should move them to prod. This can help monitor the tests more closely (avoiding issues like #105464).

Linux/android ones are ready to move, whereas the mac/ios ones are still flaky and we can monitor and move later if flake is clear.

Activity

  1. keyonghan commented on Jun 6, 2022

    @keyonghan
    ContributorAuthor

    /cc @ricardoamador could you please help with this one?

  2. ricardoamador commented on Jun 6, 2022

    @ricardoamador
    Contributor

    Yes sir. I'll take a look.

  3. keyonghan commented on Jun 6, 2022

    @keyonghan
    ContributorAuthor

    Action items:

    • Add targets in .ci.yaml (flutter/flutter)
      • bringup: true first
      • Move to prod pool by removing `bringup: true
    • remove configs from devicelab_staging_config.star (flutter/infra)
    • Move two linux/android staging testbeds to prod
  4. keyonghan commented on Jun 7, 2022

    @keyonghan
    ContributorAuthor

    /cc @zanderso These linux builders have been enabled in flutter dashboard, and will be removed from devicelab_benchmark console via https://flutter-review.googlesource.com/c/infra/+/31020.

  5. zanderso commented on Jun 8, 2022

    @zanderso
    Member

    /cc @zanderso These linux builders have been enabled in flutter dashboard, and will be removed from devicelab_benchmark console via https://flutter-review.googlesource.com/c/infra/+/31020.

    Thanks!

  6. ricardoamador commented on Jun 8, 2022

    @ricardoamador
    Contributor

    I have moved flutter-linux-14 and flutter-linux-15 from staging to prod.

  7. ricardoamador commented on Jun 16, 2022

    @ricardoamador
    Contributor

    This has been completed.

  8. ricardoamador commented on Jun 16, 2022

    @ricardoamador
    Contributor

    Reopening to track the move of the IOS bots.

  9. keyonghan commented on Aug 22, 2022

    @keyonghan
    ContributorAuthor

    F.Y.I: #110037. This should be ready to go without any blockers. /cc @ricardoamador

  10. ricardoamador commented on Aug 22, 2022

    @ricardoamador
    Contributor

    @keyonghan on it.

  11. ricardoamador commented on Aug 23, 2022

    @ricardoamador
    Contributor

    IOS Benchmark tests have been moved to prod.

  12. zanderso commented on Aug 29, 2022

    @zanderso
    Member

    Thanks!

  13. github-actions commented on Sep 12, 2022

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  14. locked as resolved and limited conversation to collaborators on Sep 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

team-infraOwned by Infrastructure team

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions