Skip to content

Flaky Fuchsia failures cause frequent tree closures. #67942

Description

@chinmaygarde

An example of such failures is https://chromium-swarm.appspot.com/task?id=4f32a561503b9b10. Currently, a substantial number of recent failures on Fuchsia are due to this error.
Screen Shot 2020-10-12 at 11 26 34 AM
The error looks like a machine is unreachable

ssh: connect to host fd5d:df04:d8c7:0:73b7:3bb5:6468:26a7 port 22: Network is unreachable

Activity

  1. added
    engineflutter/engine related. See also e: labels.
    team-infraOwned by Infrastructure team
    P0Critical issues such as a build break or regression
    on Oct 12, 2020
  2. chinmaygarde commented on Oct 12, 2020

    @chinmaygarde
    ContributorAuthor
  3. chaselatta commented on Oct 12, 2020

    @chaselatta
    Contributor

    There was a recent netstack change which was causing connection failures. The change is being reverted so this should be resolved shortly.

  4. chinmaygarde commented on Oct 12, 2020

    @chinmaygarde
    ContributorAuthor

    Excellent. Can you please cross-reference the patchset so someone can followup on it to decide when we can close this issue?

  5. chaselatta commented on Oct 12, 2020

    @chaselatta
    Contributor
  6. chinmaygarde commented on Oct 12, 2020

    @chinmaygarde
    ContributorAuthor

    The tree seems to be closed for that revert to land.

    @zanderso: We may need to attempt retries manually or disable these checks to unblock ourselves in the meantime. Or just wait it out :)

  7. chinmaygarde commented on Oct 12, 2020

    @chinmaygarde
    ContributorAuthor

    Per the internal thread, change is being force-submitted.

  8. chinmaygarde commented on Oct 12, 2020

    @chinmaygarde
    ContributorAuthor

    The patch has landed but not yet rolled into the engine because the engine tree is red (because the issue the patch purportedly fixes).

  9. chinmaygarde commented on Oct 13, 2020

    @chinmaygarde
    ContributorAuthor

    The patch was rolled into the engine and I don't see any new failures after the roll. I'm going to call this one a success.

  10. 4 remaining items

  11. zanderso commented on Oct 14, 2020

    @zanderso
    Member

    I have reverted the Fuchsia SDK roll to back before the flake started. If/When that clears things up, I'll downgrade this from P0.

  12. kf6gpe commented on Oct 14, 2020

    @kf6gpe
    Contributor

    @chaselatta told me via other channels that:

    "I got a conversation started with the netstack team and some of the flutter folks. We also have created a bug (fxb/61962) which is tracking this internally with the connectivity team and it's been added to the chaselist."

  13. added a commit that references this issue on Oct 16, 2020
  14. chinmaygarde commented on Oct 19, 2020

    @chinmaygarde
    ContributorAuthor

    @zanderso says this should be fixed upstream by the Fuchsia netstack team. He will followup on the roll into the engine.

  15. chinmaygarde commented on Oct 20, 2020

    @chinmaygarde
    ContributorAuthor

    From triage of presubmit flakes reported by users, this one still seems to be an ongoing issue with the following report:

  16. zanderso commented on Oct 20, 2020

    @zanderso
    Member

    @chinmaygarde that presubmit run was before the Fuchsia SDK roll that included the fix here flutter-team-archive/engine@ea2aea1. Since then I haven't seen any flakes, so I will close this.

  17. github-actions commented on Aug 11, 2021

    @github-actions

    This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

  18. locked as resolved and limited conversation to collaborators on Aug 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P0Critical issues such as a build break or regressionc: flakeTests that sometimes, but not always, incorrectly passengineflutter/engine related. See also e: labels.platform-fuchsiaFuchsia code specificallyteam-infraOwned by Infrastructure team

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions