Skip to content

Quoted version metadata creates a false missing-file reference and changes score 0 from SAFE to CAUTION #524

Open

Description

@Patrick-Erichsen

SkillSpector 2.11.2 treats metadata.version: "1.2" in SKILL.md frontmatter as a missing local-file reference. This marks an otherwise complete, harmless scan as partial and changes its recommendation to CAUTION despite score 0 and zero findings.

Reproduction needs no API credentials:

---
name: greeting
description: Write a friendly greeting.
metadata:
  version: "1.2"
---

# Greeting
Write a friendly greeting for the user.

Save that as version-reference-fixture/SKILL.md, then run:

skillspector scan ./version-reference-fixture --no-llm --format json --output report.json

Repeat after removing just the metadata and version lines.

Input Score Findings Recommendation Complete
No version metadata 0 0 SAFE true
metadata.version: "1.2" 0 0 CAUTION false

Both runs finish successfully with 100% component coverage. The failing variant has exactly one ledger exception: reference_resolution / reference_unresolved at SKILL.md:5. Its analysis_completeness.references entry is:

{
  "source_path": "SKILL.md",
  "line": 5,
  "column": 13,
  "evidence": "version: \"1.2\"",
  "target_path": null,
  "status": "missing",
  "disposition": "partial"
}

Expected: quoted version metadata should not be classified as a local-file dependency. The risk score and findings should remain unchanged, and this metadata alone should not make analysis partial.

This also occurs in the API Gateway skill on ClawHub. That larger skill has additional completeness exceptions, so this reproduction isolates the metadata bug rather than claiming it is the only cause of its CAUTION result.

Related: #510 concerns output-file references, and #450 / #451 concern slash-separated prose. This case is a quoted version value in YAML frontmatter.

Activity

  1. added 2 commits that reference this issue on Sep 11, 2026
    f785d45
    1f2739f
  2. added 2 commits that reference this issue on Sep 15, 2026
    4305b84
    ad6b0bd
  3. rng1995 commented on Sep 16, 2026

    @rng1995
    Collaborator

    Implementation is in progress in PR #525, which rejects quoted version numbers as local file references. Keeping this issue open until the PR merges and the SAFE/completeness regression is verified on main.

  4. rng1995 commented on Oct 4, 2026

    @rng1995
    Collaborator

    PR-state snapshot checked on 2026-10-04:

    • PR #525 — open, non-draft; GitHub review decision: changes requested; merge conflicts reported; latest reported check rollup: success.

    Keeping this issue open: the relevant implementation is not merged. Check/review status is a point-in-time snapshot, not a claim of merge readiness.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions