You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
test_runner: with --test-isolation=none, a file that throws after registering a test passes (exit 0, error not shown) #66549
Found while running a mutation tester (Stryker) with --test-isolation=none to speed it up: a mutant that made a rule throw on one input survived, because the table-driven test file that computes its cases at load time stopped partway through and the run still exited 0. With several files, the other files' tests run and the broken file's later tests just disappear from the count (129 of 198 in that case), so nothing looks wrong unless you compare totals.
Possibly related: #64833 (--test-force-exit with concurrency loses verdicts and exits 0).
Activity
test_runner: report load errors with --test-isolation=none
test_runner: report load errors with --test-isolation=none