Skip to content

Merge more Flutter debug tests to speed up test runs - #6168

Merged
DanTup merged 1 commit into
merge-debug-testsfrom
merge-debug-tests-2
Sep 5, 2026
Merged

DanTup merged 1 commit into
merge-debug-testsfrom
merge-debug-tests-2

Conversation

@DanTup

@DanTup DanTup commented Sep 5, 2026

Copy link
Copy Markdown
Member

Spawning a real Flutter app is very slow, so combining some of these tests to check multiple things speeds up the whole run significantly.

See #6165

@DanTup DanTup added this to the v3.144.0 milestone Sep 5, 2026
@DanTup DanTup added the is testing Relates to the testing (either manual or automated) of Dart Code label Sep 5, 2026
@codecov

codecov Bot commented Sep 5, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.77%. Comparing base (0f3a1a8) to head (5dc2a55).

Additional details and impacted files
@@                  Coverage Diff                  @@
##           merge-debug-tests    #6168      +/-   ##
=====================================================
- Coverage              70.87%   70.77%   -0.11%     
=====================================================
  Files                    170      170              
  Lines                  13158    13158              
  Branches                2649     2649              
=====================================================
- Hits                    9326     9312      -14     
- Misses                  3314     3325      +11     
- Partials                 518      521       +3     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Spawning a real Flutter app is very slow, so combining some of these tests to check multiple things speeds up the whole run significantly.

See #6165
@DanTup
DanTup force-pushed the merge-debug-tests-2 branch from 73e8a06 to 5dc2a55 Compare September 5, 2026 14:52
DanTup added a commit that referenced this pull request Sep 5, 2026
Spawning a real Flutter app is very slow, so combe these to have a single launch.

See #6165
@DanTup
DanTup requested a lite review from Copilot September 5, 2026 15:04

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

Changes are limited to test code/test fixtures and the updated assertions and control flow appear consistent and complete for both device and web paths.

Pull request overview

This PR speeds up CI by merging several Flutter “flutter run” debug integration tests so fewer real Flutter apps need to be spawned, while still validating the same debugger behaviours (stepping, frame categorisation, and error output).

Changes:

  • Added a print() call to the SDK-throwing Flutter test app to provide a reliable stepping target into the SDK.
  • Consolidated SDK/external/local library stepping + frame-category assertions into fewer combined tests (with device-vs-web branching where needed).
  • Merged exception-output metadata assertions and structured error rendering checks into a single test.
File summaries
File Description
src/test/test_projects/flutter_hello_world/lib/throw_in_sdk_code.dart Adds a print() call used as a breakpoint/step-in target for SDK stepping tests.
src/test/flutter_debug/flutter_run.test_device_and_web.test.ts Merges multiple Flutter debug tests into fewer runs while keeping coverage for stepping + frame categories and error/structured output assertions.
Review details
  • Files reviewed: 2/2 changed files
  • Comments generated: 0
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

DanTup added a commit that referenced this pull request Sep 5, 2026
@DanTup
DanTup merged commit c9dbcae into master Sep 5, 2026
25 checks passed
DanTup added a commit that referenced this pull request Sep 5, 2026
Spawning a real Flutter app is very slow, so combe these to have a single launch.

See #6165
DanTup added a commit that referenced this pull request Sep 5, 2026
@DanTup
DanTup deleted the merge-debug-tests-2 branch September 7, 2026 08:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

is testing Relates to the testing (either manual or automated) of Dart Code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants