Skip to content

fix(devlore-test): three fixtures assert text the runtime no longer produces (#875) - #878

Merged
David-Noble-at-work merged 2 commits into
developfrom
fix/875-fixtures-assert-stale-text
Sep 10, 2026
Merged

David-Noble-at-work merged 2 commits into
developfrom
fix/875-fixtures-assert-stale-text

Conversation

@David-Noble-at-work

@David-Noble-at-work David-Noble-at-work commented Sep 10, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Closes #875.

Three data/*.star fixtures assert text the runtime stopped producing. Each fails when run through the CLI on develop — the runtime is right, the fixtures are stale.

Fixture Asserted Runtime emits
test_imm_shell.star shell.exec(...) == "echo hello" a *Result rendering as "Result"; fields reached individually
test_flow_fatal_recovery.star "fatal: abort after write" "flow.failed executed: abort after write" (fatal→failed)
test_imm_file_join_variadic_error.star "positional and keyword" 'multiple values for argument "parts"' (Starlark's own)

test_imm_shell.star is rewritten to assert the four fields, both streams, and the render, replacing one false scalar equality and a comment that stated the contract backwards.

CI green is not the evidence here

Nothing in CI runs these fixtures — that is #876. The evidence is the CLI:

$ go run ./cmd/devlore-test run cmd/devlore-test/devloretest/data/test_imm_shell.star
  # develop: "got Result, want \"echo hello\"" ✖
  # this branch: "passed": true ✔

All three pass through devlore-test run on this branch; all three fail on develop.

Provenance and scope

Harvested from feature/shell-exec-product (a dead branch — 0 ahead of develop, its only value these uncommitted corrections). Not the shell-provider rewrite: #799 will restate test_imm_shell.star, but a false test should not wait on an open-ended redesign.

Time

Marker UTC Elapsed
opened (first commit) 2026-09-10T02:32:15Z —
submitted (PR opened) 2026-09-10T02:51:30Z 0.3 h after opened
merged 2026-09-10T03:03:16Z 0.2 h after submitted; 0.5 h in all

Computed by the algorithm of noblefactor-ops#188 at merge.

David Noble added 2 commits September 9, 2026 19:32
…roduces (#875)

Each failed when run through the CLI on develop; none is run by CI, so the rot was invisible.

- test_imm_shell.star asserted shell.exec(...) == "echo hello" under the comment "returns the command
  string, not stdout". The value is a *shell.Result whose fields are individually reachable by
  reflection; it renders as "Result". Rewritten to assert command/stdout/stderr/exit_code, both
  streams, and the render.
- test_flow_fatal_recovery.star asserted "fatal: abort after write"; the fatal action was renamed
  failed and the runtime emits "flow.failed executed: abort after write".
- test_imm_file_join_variadic_error.star asserted "positional and keyword"; Starlark itself raises
  the refusal, worded 'multiple values for argument "parts"'.

Harvested from the dead branch feature/shell-exec-product, whose only remaining value was these
uncommitted corrections. All three pass through devlore-test run, before harvest and after.

Why CI never caught it -- nothing runs the 110 non-Go-referenced data/*.star fixtures -- is #876, a
harness gate, not a fixture edit. These corrections are to the current provider; the shell-provider
rewrite (#799) will restate test_imm_shell.star, and a false test should not wait on that redesign.

Claude-Session: https://claude.ai/code/session_01BTCnSyUbYFFUKMD3PuF1vt
@David-Noble-at-work
David-Noble-at-work merged commit 5be5164 into develop Sep 10, 2026
13 checks passed
@David-Noble-at-work
David-Noble-at-work deleted the fix/875-fixtures-assert-stale-text branch September 10, 2026 03:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Three devlore-test fixtures assert text the runtime no longer produces; all three fail when run

1 participant