Issues

• [BUG]: Schema-valid ATIF structured answers disappear from judge evidence

  bug
  NVIDIA/SkillEvaluator#202 · Filter by author YMuskrat opened on Oct 12, 2026

• [BUG]: Failed SKILL.md reads receive full activation, workflow and routing credit

  bug
  NVIDIA/SkillEvaluator#200 · Filter by author YMuskrat opened on Oct 12, 2026

• [BUG]: Collector rejects valid answers when per-step ATIF tokens lack aggregate metrics

  bug
  NVIDIA/SkillEvaluator#198 · Filter by author YMuskrat opened on Oct 12, 2026

• Improve Tier 1 target coverage and Tier 3 negative-case/resource reporting

  NVIDIA/SkillEvaluator#195 · Filter by author chrisknvidia opened on Oct 11, 2026

• [BUG]: Generated BENCHMARK.md does not faithfully explain a passing gate and splits canonical case IDs

  NVIDIA/SkillEvaluator#192 · Filter by author holgerroth opened on Oct 9, 2026

• [BUG]: Accuracy judge accepts totals that contradict its five-criterion verdicts

  NVIDIA/SkillEvaluator#189 · Filter by author mavericksea-ai opened on Oct 8, 2026

• [FEA]: create a tables and rows quantitative dashboard to compare agent skill performance

  enhancement
  NVIDIA/SkillEvaluator#170 · Filter by author westonplatter opened on Sep 29, 2026

• [FEA]: make quality checks configurable

  enhancement
  NVIDIA/SkillEvaluator#169 · Filter by author westonplatter opened on Sep 29, 2026
  2

• [FEA]: Support Hermes as a Tier 3 agent with native NVIDIA Build routing

  enhancement
  NVIDIA/SkillEvaluator#150 · Filter by author chrisknvidia opened on Sep 20, 2026

• [BUG]: Unrecovered command failures are scored as first-attempt clean

  bug
  NVIDIA/SkillEvaluator#149 · Filter by author mavericksea-ai opened on Sep 20, 2026

• [FEA]: Run the container as non-root, and drop the report template's CDN dependency

  NVIDIA/SkillEvaluator#127 · Filter by author dberzan opened on Aug 31, 2026

• BenchmarkReporter can recommend publication while Tier 2 is NOT RUN

  NVIDIA/SkillEvaluator#73 · Filter by author holgerroth opened on Aug 24, 2026
  

• Proposal: an EvalPort/OpenEval adapter for SkillEvaluator's ValidationResult

  NVIDIA/SkillEvaluator#64 · Filter by author adhabnr-ux opened on Aug 23, 2026

• [BUG]: The numbers produced by this tool appear to be meaningless?

  bug
  NVIDIA/SkillEvaluator#61 · Filter by author mpgussert opened on Aug 21, 2026
  1

• ux: add consolidated Tier 1 scanner preflight and guided bootstrap

  NVIDIA/SkillEvaluator#42 · Filter by author chrisknvidia opened on Aug 5, 2026
  1

• roadmap: scale Tier 2 overlap detection for registry-sized catalogs

  NVIDIA/SkillEvaluator#41 · Filter by author chrisknvidia opened on Aug 5, 2026
  1

• policy: make metadata.author and metadata.id requirements profile-controlled

  NVIDIA/SkillEvaluator#43 · Filter by author chrisknvidia opened on Aug 5, 2026
  2