Skip to content

ci: disable npm cache for Node 10 test leg - #603

Merged
alexander-akait merged 2 commits into
mainfrom
claude/codspeed-benchmark-stability-5AaxJ
Jun 4, 2026
Merged

ci: disable npm cache for Node 10 test leg#603
alexander-akait merged 2 commits into
mainfrom
claude/codspeed-benchmark-stability-5AaxJ

Conversation

@alexander-akait

@alexander-akait alexander-akait commented Jun 4, 2026

Copy link
Copy Markdown
Member

Summary

ci fix

What kind of change does this PR introduce?

ci

Did you add tests for your changes?

Existing

Does this PR introduce a breaking change?

No

If relevant, what needs to be documented once your changes are merged or what have you already documented?

Nothing

Use of AI

Claude

@changeset-bot

changeset-bot Bot commented Jun 4, 2026 •
edited
Loading

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 05d2f7e

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@codecov

codecov Bot commented Jun 4, 2026 •
edited
Loading

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 96.55%. Comparing base (487659b) to head (05d2f7e).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files 
@@           Coverage Diff           @@
##             main     #603   +/-   ##
=======================================
  Coverage   96.55%   96.55%           
=======================================
  Files          50       50           
  Lines        3049     3049           
  Branches      979      979           
=======================================
  Hits         2944     2944           
  Misses         89       89           
  Partials       16       16
Flag Coverage Δ
integration 96.55% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@codspeed

codspeed Bot commented Jun 4, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will degrade performance by 64.11%

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
❌ 15 regressed benchmarks
✅ 117 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Memory symlinks: symlinks=false (warm) 1.8 KB 168.4 KB -98.96%
❌ Memory prefer-absolute: absolute paths (warm) 1.9 KB 161.6 KB -98.83%
❌ Simulation prefer-absolute: absolute paths (warm) 799.8 µs 13,561.5 µs -94.1%
❌ Simulation unsafe-cache: OFF, 3x repeat 4.5 ms 72.3 ms -93.73%
❌ Simulation unsafe-cache: ON, 3x repeat 936.1 µs 14,584 µs -93.58%
❌ Simulation symlinks: symlinks=false (warm) 408.4 µs 5,794.5 µs -92.95%
❌ Simulation symlinks: follow symlinks=true (warm) 1.7 ms 19.4 ms -91.36%
❌ Memory unsafe-cache-miss-heavy: 1 miss pass + 1 hit pass 1.2 KB 4.6 KB -74.85%
❌ Memory symlinks: follow symlinks=true (warm) 129.2 KB 486.4 KB -73.44%
❌ Memory realistic-midsize: mixed batch (warm cache) 1.9 KB 4.6 KB -58.59%
❌ Memory restrictions: path prefix + regex (warm) 2 KB 4.5 KB -55.05%
❌ Memory self-reference: import own package name (warm) 1,005 B 1,840 B -45.38%
❌ Memory tsconfig-extends: 3-level extends chain (warm) 2.7 KB 4.9 KB -43.64%
❌ Memory roots: server-relative paths (warm) 1,020 B 1,804 B -43.46%
❌ Simulation unsafe-cache-miss-heavy: 1 miss pass + 1 hit pass 3.9 ms 4.4 ms -10.58%
⚡ Memory query-fragment: ?query + #fragment mix (warm) 97.8 KB 1 KB ×98
⚡ Memory unsafe-cache: OFF, 3x repeat 96.4 KB 24.6 KB ×3.9
⚡ Memory prefer-relative: bare-as-relative (warm) 2.2 KB 1 KB ×2.1
⚡ Simulation query-fragment: ?query + #fragment mix (warm) 1.6 ms 1.3 ms +29.72%
⚡ Simulation resolve-to-context: directory resolve (warm) 343 µs 308.3 µs +11.24%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing claude/codspeed-benchmark-stability-5AaxJ (05d2f7e) with main (fcb3e3f)

Open in CodSpeed

@alexander-akait
ci: disable npm cache for legacy Node test legs (10-16)
f6d625e 
These legs reinstall deps after dropping or bypassing package-lock.json, so
there's no lockfile for setup-node's npm cache to key on.
@alexander-akait
test: stabilize flaky CodSpeed memory benchmarks
05d2f7e 
Warm cache-hit cases (symlinks, prefer-absolute, unsafe-cache) allocate only
a few KB, so incidental allocation swung memory-mode results by tens of
percent on no-op changes. Repeat each batch to lift allocation above the
noise floor; benchmark names are unchanged so CodSpeed history carries over.
@alexander-akait
alexander-akait force-pushed the claude/codspeed-benchmark-stability-5AaxJ branch from d27508f to 05d2f7e Compare June 4, 2026 14:51
@alexander-akait
alexander-akait merged commit 38a5aa8 into main Jun 4, 2026
34 checks passed
@alexander-akait
alexander-akait deleted the claude/codspeed-benchmark-stability-5AaxJ branch June 4, 2026 15:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@alexander-akait