Skip to content

SubprocessCluster: fix random crash on start - #9292

Merged
crusaderky merged 1 commit into
dask:mainfrom
crusaderky:subprocesscluster
Jun 9, 2026
Merged

crusaderky merged 1 commit into
dask:mainfrom
crusaderky:subprocesscluster

Conversation

@crusaderky

Copy link
Copy Markdown
Collaborator

Fix a race condition where SubprocessCluster would crash on start with

RuntimeError: Cluster failed to start: Expecting value: line 1 column 1 (char 0)

e.g. https://github.com/dask/distributed/actions/runs/27200027227/job/80301891998?pr=9282

this was due to a race condition where the scheduler_file already exists on disk, but it has not been written to yet.

@crusaderky crusaderky changed the title Fix race condition in SubprocessCluster startup SubprocessCluster: fix race condition at startup Jun 9, 2026
@crusaderky crusaderky changed the title SubprocessCluster: fix race condition at startup SubprocessCluster: fix random crash on start Jun 9, 2026
@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

    40 files  ±0      40 suites  ±0   14h 25m 38s ⏱️ +45s
 4 153 tests ±0   3 972 ✅ +1    178 💤 ±0  3 ❌  - 1 
80 821 runs  +1  76 580 ✅ ±0  4 238 💤 +2  3 ❌  - 1 

For more details on these failures, see this check.

Results for commit c70fc50. ± Comparison against base commit de40898.

@crusaderky
crusaderky merged commit f2c923a into dask:main Jun 9, 2026
48 of 52 checks passed
@crusaderky crusaderky mentioned this pull request Jun 9, 2026
1 task
@crusaderky
crusaderky deleted the subprocesscluster branch June 9, 2026 13:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant