Skip to content

Show some feedback when starting an integration test while build is in-progress #5654

Closed

Description

@mhernz

Describe the bug
When launching a test with Flutter integration_test on a device or emulator, there is no feedback besides a spinner on "Dart" in the "Test Results" sidebar indicating that a build is occurring. Sometimes this spinner doesn't appear either

This is especially problematic when trying to run tests on multiple targets at the same time

To Reproduce

  • Create a test with IntegrationTestWidgetsFlutterBinding.ensureInitialized();
  • Click Debug button in file or Debug Tests in explorer view

Expected behavior
There should be a popup notification and some lines in debug console indicating a build is occurring, like when you perform a regular app run

Screenshots
Only after the build is complete is a debug console tab created and the "Running Gradle task..." message appears
Image

Image

Please complete the following information:

You can run the Dart: Collect Diagnostic Information command from the VS Code command palette (F1) to easily capture this information or provide it manually.

  • Operating System and version: macOS 15.5
  • VS Code version: Cursor 1.4.3
  • Dart extension version: 3.116.0
  • Dart/Flutter SDK version: Dart 3.8.1/Flutter 3.32.8
  • Target device (if the issue relates to Flutter debugging): Android emulator

Activity

  1. DanTup commented on Aug 26, 2025

    @DanTup
    Member

    I can repro this. Here's the output of flutter test integration_test/foo_test.dart:

    {"protocolVersion":"0.1.1","runnerVersion":null,"pid":17300,"type":"start","time":0}
    {"suite":{"id":0,"platform":"vm","path":"D:/Dev/Test Projects/dartcode_5654/integration_test/app_test.dart"},"type":"suite","time":0}
    {"test":{"id":1,"name":"loading D:/Dev/Test Projects/dartcode_5654/integration_test/app_test.dart","suiteID":0,"groupIDs":[],"metadata":{"skip":false,"skipReason":null},"line":null,"column":null,"url":null},"type":"testStart","time":0}
    {"count":1,"time":3,"type":"allSuites"}
    
    //////// DELAY IS HERE ////////
    
    ✓ Built build\windows\x64\runner\Debug\dartcode_5654.exe
    
    [{"event":"test.startedProcess","params":{"vmServiceUri":"http://127.0.0.1:65195/1yCX3FnwY64=/"}}]
    {"testID":1,"result":"success","skipped":false,"hidden":true,"type":"testDone","time":8366}
    {"group":{"id":2,"suiteID":0,"parentID":null,"name":"","metadata":{"skip":false,"skipReason":null},"testCount":1,"line":null,"column":null,"url":null},"type":"group","time":8368}
    {"group":{"id":3,"suiteID":0,"parentID":2,"name":"end-to-end test","metadata":{"skip":false,"skipReason":null},"testCount":1,"line":9,"column":3,"url":"file:///D:/Dev/Test%20Projects/dartcode_5654/integration_test/app_test.dart"},"type":"group","time":8368}
    {"test":{"id":4,"name":"end-to-end test tap on the floating action button, verify counter","suiteID":0,"groupIDs":[2,3],"metadata":{"skip":false,"skipReason":null},"line":174,"column":5,"url":"package:flutter_test/src/widget_tester.dart","root_line":10,"root_column":5,"root_url":"file:///D:/Dev/Test%20Projects/dartcode_5654/integration_test/app_test.dart"},"type":"testStart","time":8368}
    {"testID":4,"result":"success","skipped":false,"hidden":false,"type":"testDone","time":9187}
    {"test":{"id":5,"name":"(tearDownAll)","suiteID":0,"groupIDs":[2],"metadata":{"skip":false,"skipReason":null},"line":50,"column":5,"url":"package:integration_test/integration_test.dart"},"type":"testStart","time":9188}
    {"testID":5,"result":"success","skipped":false,"hidden":true,"type":"testDone","time":9191}
    {"success":true,"type":"done","time":9195}
    

    For normal tests the delay is probably never enough for this to be noticed, but with a compile it is. We should either start a notification immediately and keep it visible until the tests start (I think we might do this for run?), or use the "Loading...." test as a signal to show progress until the tests start.

  2. added this to the v3.118.0 milestone on Aug 26, 2025
  3. changed the title [-]integration_test - no feedback in debug console until build is complete[/-] [+]Show some feedback when starting an integration test while build is in-progress[/+] on Aug 26, 2025
  4. added
    is enhancementAn enhancement or improvement that should be listed in release notes but is not a bug fix.
    in flutterRelates to running Flutter apps
    in testingRelates to test execution of Dart/Flutter tests for end users
    and removed on Aug 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    in flutterRelates to running Flutter appsin testingRelates to test execution of Dart/Flutter tests for end usersis enhancementAn enhancement or improvement that should be listed in release notes but is not a bug fix.

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions