Skip to content

Many tests in the SDK do not work through the test runner #5471

Closed

Description

@DanTup

In the latest release, we removed the code that forced the SDK repo to always run tests through dart instead of the test runner. It turns out there are quite a few tests in the SDK that fail when run through the runner.

Some are being discussed in dart-lang/sdk#60437 (comment), but I also found some analysis server integration tests fail too (unsure if this is Windows-specific or not, but I suspect not):

Image

Image

We should first try to update these tests to work with the test runner, but if it proves not to be trivial, we should consider putting the flag back for now.

Activity

  1. added
    in testingRelates to test execution of Dart/Flutter tests for end users
    on Apr 1, 2025
  2. added this to the v3.110.0 milestone on Apr 1, 2025
  3. DanTup commented on Apr 1, 2025

    @DanTup
    MemberAuthor

    @jakemac53 some of the analysis server ones are because Platform.script doesn't return what the test expects (the path to the test script) when running through the test runner:

    Image

    I'm guessing this is known/expected. I presume there's no way for pkg:test to override this? If not, is there a way to get at the real test script path?

    Edit: dart-lang/test#110 seems related

  4. modified the milestones: v3.110.0, v3.112.0 on Apr 30, 2025
  5. modified the milestones: v3.112.0, v3.114.0 on May 27, 2025
  6. modified the milestones: v3.114.0, v3.116.0 on Jun 23, 2025
  7. DanTup commented on Jul 21, 2025

    @DanTup
    MemberAuthor

    Many issues related to this have been fixed. If there are still remaining issues, we can file new issues for them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    in testingRelates to test execution of Dart/Flutter tests for end usersis bug

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions