Integration test with integration_test package #3009

Activity

1. bsr203

   added

   is enhancementAn enhancement or improvement that should be listed in release notes but is not a bug fix.An enhancement or improvement that should be listed in release notes but is not a bug fix.

   on Dec 12, 2020
2. bsr203

   changed the title [-]Integration test with `flutter drive` command[/-] [+]Integration test with integration_test package[/+] on Dec 12, 2020
3. bsr203 commented on Dec 15, 2020

   

   bsr203

   on Dec 15, 2020

   Author

   More actions

   updating with some of the comments from @DanTup

   The args should show up in the args field there according to the code:
   
   debugConfig.args = conf.flutterAdditionalArgs.concat(isTest ? conf.flutterTestAdditionalArgs : []).concat(debugConfig.args);
   
   
   
   Which makes me think it's deciding this file is not a test
   Ah, it's the folder
   
   && (isInsideFolderNamed(file, "test") || isInsideFolderNamed(file, "test_driver") || config.allowTestsOutsideTestFolder)
   
   If you want to have tests outside of test/test_driver, you need to set the dart.allowTestsOutsideTestFolder setting
   
   
   DanTupToday at 12:48 PM
   though arguably if integration_test is a common folder, we should add that to the list
   
   
   
   DanTupToday at 12:54 PM
   Ah, I see - so it looks like you need to run the tests using flutter drive. Since you changed that setting, we would now be running with flutter test. I think it's going to need some work to properly support this
   
   DanTupToday at 12:55 PM
   I think we should detect tests inside integration_test and run them with flutter drive, and maybe have a flutterDriveAdditionalArgs or similar
   
   
   
   Great, thanks!
   How are you running from the terminal? Is it like this?
   
   flutter drive \
     --driver=test_driver/integration_test.dart \
     --target=integration_test/foo_test.dart \
     -d <DEVICE_ID>
   I guess we need to have a way to find the test_driver script (perhaps by convention, if it exists with that name?)
   bsr203Today at 12:59 PM
   
    flutter drive   --driver=test_driver/integration_test.dart   --target=integration_test/app_test.dart   -d android --flavor dev
   
   DanTupToday at 1:00 PM
   Got it. The docs seem to suggest using that path for the driver script, so I think we can assume if that file exists and the current file is in integration_test, then we can run it like this. Thanks!
   
   
4. bsr203 commented on Dec 15, 2020

   

   bsr203

   on Dec 15, 2020

   Last edited by bsr203

   Author

   More actions

   key finding are:
   dart-code uses folder to decide test. integration_test is not in the list, but is currently recommended by flutter docs.
   integration test uses flutter drive command, so code lens need to use it instead of flutter test for integration tests.
   integration test needs to honor flutterTestAdditionalArgs, or need similar flag to pass arguments
5. DanTup

   added this to the v3.18.0 milestone on Dec 16, 2020
6. DanTup

   added

   in debuggingRelates to the debug adapter or process of running debug sessionsRelates to the debug adapter or process of running debug sessions

   in flutterRelates to running Flutter appsRelates to running Flutter apps

   on Dec 16, 2020
7. DanTup

   modified the milestones: v3.18.0, v3.19.0 on Dec 21, 2020
8. DanTup

   modified the milestones: v3.19.0, On Deck on Jan 19, 2021
9. DanTup

   modified the milestones: On Deck, v3.20.0 on Feb 8, 2021
10. DanTup

    added a commit that references this issue on Feb 11, 2021

    Recognise "integration_test" folder as tests that require a device

    ...

    2edc5d4
11. DanTup

    modified the milestones: v3.20.0, v3.21.0 on Feb 17, 2021
12. DanTup

    modified the milestones: v3.21.0, v3.22 on Mar 22, 2021
13. DanTup

    added a commit that references this issue on Apr 1, 2021

    Recognise "integration_test" folder as tests that require a device

    ...

    0ab7068
14. DanTup

    added a commit that references this issue on Apr 13, 2021

    Recognise "integration_test" folder as tests that require a device

    ...

    c1e6e30
15. DanTup

    closed this as completedin #3133on Apr 15, 2021
16. DanTup

    added a commit that references this issue on Apr 15, 2021

    Recognise "integration_test" folder as tests that require a device

    ...

    1f0728a