Skip to content

Some Video playback policy tests fail on Xcode 16 #164632

Open
Open
Some Video playback policy tests fail on Xcode 16#164632
Labels
P2Important issues not at the top of the work lista: tests"flutter test", flutter_test, or one of our testsp: webviewThe WebView pluginpackageflutter/packages repository. See also p: labels.t: xcode"xcodebuild" on iOS and general Xcode project managementteam-iosOwned by iOS platform teamtoolAffects the "flutter" command-line tool. See also t: labels.triaged-iosTriaged by iOS platform team

Description

@vashworth
vashworth
opened on Mar 5, 2025

What package does this bug report belong to?

webview_flutter

What target platforms are you seeing this bug on?

iOS

Have you already upgraded your packages?

Yes

Dependency versions

pubspec.lock 
[Paste file content here]

Steps to reproduce

Video playback policy Changes to initialMediaPlaybackPolicy are ignored and Video playback policy Auto media playback fail in CI with Xcode 16c5032a

Expected results

Test to pass

Actual results

https://ci.chromium.org/ui/p/flutter/builders/try/Mac_arm64%20ios_platform_tests_shard_5%20master/20439/overview

01:07 +42 ~2: /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart: Video playback policy Auto media playback
══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
The following TestFailure was thrown running a test:
Expected: '0'
  Actual: '1'
   Which: is different.
          Expected: 0
            Actual: 1
                    ^
           Differ at offset 0

When the exception was thrown, this was the stack:
#4      main.<anonymous closure>.<anonymous closure> (file:///Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart:409:7)
<asynchronous suspension>
#5      testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:193:15)
<asynchronous suspension>
#6      TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1064:5)
<asynchronous suspension>
<asynchronous suspension>
(elided one frame from package:stack_trace)

This was caught by the test expectation on the following line:
  file:///Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart line 409
The test description was:
  Auto media playback
════════════════════════════════════════════════════════════════════════════════════════════════════

01:07 +42 ~2 -1: /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart: Video playback policy Auto media playback [E]
  Test failed. See exception logs above.
  The test description was: Auto media playback
  

To run this test again: /Volumes/Work/s/w/ir/x/w/flutter/bin/cache/dart-sdk/bin/dart test /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart -p vm --plain-name 'Video playback policy Auto media playback'

01:07 +42 ~2 -1: ... Video playback policy Changes to initialMediaPlaybackPolicy are ignored                                                                                                           
01:08 +42 ~2 -1: ... Video playback policy Changes to initialMediaPlaybackPolicy are ignored                                                                                                           
01:08 +42 ~2 -1: /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart: Video playback policy Changes to initialMediaPlaybackPolicy are ignored
══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
The following TestFailure was thrown running a test:
Expected: '0'
  Actual: '1'
   Which: is different.
          Expected: 0
            Actual: 1
                    ^
           Differ at offset 0

When the exception was thrown, this was the stack:
#4      main.<anonymous closure>.<anonymous closure> (file:///Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart:468:7)
<asynchronous suspension>
#5      testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:193:15)
<asynchronous suspension>
#6      TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1064:5)
<asynchronous suspension>
<asynchronous suspension>
(elided one frame from package:stack_trace)

This was caught by the test expectation on the following line:
  file:///Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart line 468
The test description was:
  Changes to initialMediaPlaybackPolicy are ignored
════════════════════════════════════════════════════════════════════════════════════════════════════

01:08 +42 ~2 -2: /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart: Video playback policy Changes to initialMediaPlaybackPolicy are ignored [E]
  Test failed. See exception logs above.
  The test description was: Changes to initialMediaPlaybackPolicy are ignored
  

To run this test again: /Volumes/Work/s/w/ir/x/w/flutter/bin/cache/dart-sdk/bin/dart test /Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart -p vm --plain-name 'Video playback policy Changes to initialMediaPlaybackPolicy are ignored'

Code sample

https://github.com/flutter/packages/blob/3e55269c4cd9e1761040129724ecb130b048086d/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart#L382

Screenshots or Videos

No response

Logs

No response

Flutter Doctor output

Doctor output 
[Paste your output here]

Activity

  1. vashworth commented on Mar 5, 2025

    @vashworth
    vashworth
    on Mar 5, 2025
    ContributorAuthor

    May be related: #148487

  2. vashworth
    changed the title [-]Test `Video playback policy Auto media playback` failing on Xcode 16[/-] [+]Some `Video playback policy` tests fail on Xcode 16[/+] on Mar 5, 2025

  3. vashworth commented on Mar 5, 2025

    @vashworth
    vashworth
    on Mar 5, 2025
    ContributorAuthor

    I can't recreate this locally.

  4. vashworth commented on Mar 5, 2025

    @vashworth
    vashworth
    on Mar 5, 2025
    ContributorAuthor

    @cbracken Any ideas on how to debug this?

  5. darshankawar
    added
    in triagePresently being triaged by the triage team
    a: tests"flutter test", flutter_test, or one of our tests
    toolAffects the "flutter" command-line tool. See also t: labels.
    p: webviewThe WebView plugin
    t: xcode"xcodebuild" on iOS and general Xcode project management
    packageflutter/packages repository. See also p: labels.
    team-iosOwned by iOS platform team
    and removed
    in triagePresently being triaged by the triage team
    on Mar 6, 2025
  6. vashworth
    added
    P1High-priority issues at the top of the work list
    triaged-iosTriaged by iOS platform team
    on Mar 19, 2025

  7. vashworth commented on Mar 20, 2025

    @vashworth
    vashworth
    on Mar 20, 2025
    ContributorAuthor

    Sometimes also fails on macOS:
    https://ci.chromium.org/ui/p/flutter/builders/try/Mac_arm64%20macos_platform_tests%20master%20-%20packages/20684/overview

    Video playback policy Auto media playback                                                                                                                                                    
 ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
 The following TestFailure was thrown running a test:
 Expected: 'false'
   Actual: '0'
    Which: is different.
           Expected: false
             Actual: 0
                     ^
            Differ at offset 0
 When the exception was thrown, this was the stack:
 #4      main.<anonymous closure>.<anonymous closure> (file:///Volumes/Work/s/w/ir/x/w/packages/packages/webview_flutter/webview_flutter_wkwebview/example/integration_test/legacy/webview_flutter_test.dart:375:9)
 <asynchronous suspension>
 #5      testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:193:15)
 <asynchronous suspension>
 #6      TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1064:5)
 <asynchronous suspension>
 <asynchronous suspension>
 (elided one frame from package:stack_trace)

  8. 8 remaining items

  9. vashworth
    added
    P2Important issues not at the top of the work list
    on Apr 7, 2025
  10. CodixNinja
    added 2 commits that reference this issue on May 15, 2025

    [webview_flutter] Fix macOS test issues and skip some legacy iOS test…

    dcf999b

    [webview_flutter] Skip flaky legacy tests on iOS (#8911)

    d48b541
  11. androidseb
    added 2 commits that reference this issue on Jun 8, 2025

    [webview_flutter] Fix macOS test issues and skip some legacy iOS tests (

    f9869cc

    [webview_flutter] Skip flaky legacy tests on iOS (flutter#8911)

    1b846e1
  12. FMorschel
    added 2 commits that reference this issue on Jun 9, 2025

    [webview_flutter] Fix macOS test issues and skip some legacy iOS tests (

    5457c3b

    [webview_flutter] Skip flaky legacy tests on iOS (flutter#8911)

    27042c0
  13. Jyndigo
    added 2 commits that reference this issue on Jun 24, 2025

    [webview_flutter] Fix macOS test issues and skip some legacy iOS test…

    549333a

    [webview_flutter] Skip flaky legacy tests on iOS (#8911)

    8e7ad4f
  14. Jyndigo
    added 2 commits that reference this issue on Apr 15, 2026

    [webview_flutter] Fix macOS test issues and skip some legacy iOS test…

    b0656b8

    [webview_flutter] Skip flaky legacy tests on iOS (#8911)

    ec92da2
  15. creatorpiyush
    added 2 commits that reference this issue on Jun 10, 2026

    [webview_flutter] Fix macOS test issues and skip some legacy iOS tests (

    93d1194

    [webview_flutter] Skip flaky legacy tests on iOS (flutter#8911)

    d75a122
  16. bisor0627
    added 2 commits that reference this issue on Jun 19, 2026

    [webview_flutter] Fix macOS test issues and skip some legacy iOS tests (

    4284a88

    [webview_flutter] Skip flaky legacy tests on iOS (flutter#8911)

    55fb944
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issues not at the top of the work lista: tests"flutter test", flutter_test, or one of our testsp: webviewThe WebView pluginpackageflutter/packages repository. See also p: labels.t: xcode"xcodebuild" on iOS and general Xcode project managementteam-iosOwned by iOS platform teamtoolAffects the "flutter" command-line tool. See also t: labels.triaged-iosTriaged by iOS platform team

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions