Skip to content

test: run WebpackCli suite under Bun instead of skipping - #21334

Merged
alexander-akait merged 5 commits into
mainfrom
test/webpack-cli-bun
Jul 4, 2026
Merged

alexander-akait merged 5 commits into
mainfrom
test/webpack-cli-bun

Conversation

@alexander-akait

@alexander-akait alexander-akait commented Jul 4, 2026 •

Copy link
Copy Markdown
Member

Summary

WebpackCli.longtest.js was skipped on Bun because Bun 1.3.11 segfaults when jest drives a native vm.SyntheticModule (its dynamic import() wrapper) through link/evaluate; the Bun preloader now substitutes a pure-JS stand-in for jest-runtime's wrappers, and webpack-cli is bumped to ^7.2.1, which ships the CLIPlugin import interop fix from webpack/webpack-cli#4799. The suite now passes 20/20 under Bun and stays 20/20 under Node.

What kind of change does this PR introduce?

test

Did you add tests for your changes?

No new tests; the previously-skipped test/WebpackCli.longtest.js suite now runs under Bun.

Does this PR introduce a breaking change?

No

If relevant, what needs to be documented once your changes are merged or what have you already documented?

n/a

Use of AI

Written with Claude Code: it diagnosed the Bun segfault and interop bug and authored the fix; verified by running the suite under Bun 1.3.11 and Node, plus lint/format checks.

Bun segfaults driving jest's native vm.SyntheticModule (its dynamic
import() wrapper) through link/evaluate; substitute a pure-JS stand-in
in the Bun preloader. webpack-cli 7.1.0's CLIPlugin import interop also
breaks under Bun; bridge with a test-only patch (applied in the CI Bun
job) until an upstream release ships the fix.
Copilot AI review requested due to automatic review settings July 4, 2026 18:13
@changeset-bot

changeset-bot Bot commented Jul 4, 2026 •

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: c479263

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions

github-actions Bot commented Jul 4, 2026 •

Copy link
Copy Markdown
Contributor

This PR is packaged and the instant preview is available (413b0be).

Install it locally:

  • npm
npm i -D webpack@https://pkg.pr.new/webpack@413b0be
  • yarn
yarn add -D webpack@https://pkg.pr.new/webpack@413b0be
  • pnpm
pnpm add -D webpack@https://pkg.pr.new/webpack@413b0be

@codecov

codecov Bot commented Jul 4, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 92.64%. Comparing base (7639066) to head (c479263).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main   #21334   +/-   ##
=======================================
  Coverage   92.64%   92.64%           
=======================================
  Files         594      594           
  Lines       65951    65951           
  Branches    18328    18328           
=======================================
  Hits        61103    61103           
  Misses       4848     4848           
Flag Coverage Δ
css-parsing 28.73% <ø> (ø)
html5lib 28.41% <ø> (ø)
integration 88.80% <ø> (ø)
test262 45.43% <ø> (+0.03%) ⬆️
unit 43.70% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR enables running the existing WebpackCLI longtest suite under Bun by removing a Bun-specific skip, and adds Bun-only CI patching/preload adjustments to work around Bun + jest vm behavior and a webpack-cli interop issue.

Changes:

  • Unskip test/WebpackCli.longtest.js under Bun so the integration suite runs.
  • Extend the Bun Jest preload to avoid Bun segfaults around vm.SyntheticModule and normalize dynamic import behavior.
  • Apply a Bun-only webpack-cli patch in CI to fix CLIPlugin import interop until an upstream release lands.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File Description
test/WebpackCli.longtest.js Removes the Bun skip so the WebpackCLI integration suite runs under Bun.
test/bun-preload.js Adds a vm.SyntheticModule stand-in and adjusts dynamic import namespace handling for Bun + jest.
test/patches/webpack-cli+7.1.0.patch Introduces a Bun-only patch to fix webpack-cli CLIPlugin import interop under Bun.
.github/workflows/test.yml Applies the new Bun-only webpack-cli patch during the Bun CI job.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread test/bun-preload.js
Comment on lines +53 to +63
async evaluate() {
if (this.status !== "linked") return;
try {
this._evaluationCallback();
this.status = "evaluated";
} catch (err) {
this.status = "errored";
this.error = err;
throw err;
}
}

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The callback is invoked as this._evaluationCallback() — a method call on the module instance — so this inside the callback is the module and this.setExport(...) works (the previous explicit .call(this) was flagged by no-useless-call for exactly this reason; the suite passes 20/20 under Bun with this code). On the promise point: Node's SyntheticModule evaluation callback is synchronous by definition and its return value is ignored, so awaiting it would diverge from the semantics we're standing in for.


Generated by Claude Code

Comment thread test/patches/webpack-cli+7.1.0.patch Outdated
Comment on lines +1 to +5
Bun-only test patch (applied in the CI Bun job, like jest-worker):
webpack-cli 7.1.0 unwraps its CLIPlugin dynamic import twice (`.default.default`),
correct under Node's CJS interop but `undefined` under Bun, which honors
`__esModule` and unwraps once already. Drop when webpack's webpack-cli
dependency includes the upstream interop fix.
Comment thread .github/workflows/test.yml Outdated
Comment on lines +339 to +340
# webpack-cli 7.1.0's CLIPlugin import interop breaks under Bun; see the
# patch header. Needed by WebpackCli.longtest.js until an upstream release.
Move the rationale into the patched code and the workflow comment so
the patch file parses as a plain diff.
@codspeed

codspeed Bot commented Jul 4, 2026 •

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 3 improved benchmarks
❌ 5 regressed benchmarks
✅ 136 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Memory benchmark "side-effects-reexport", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 131.7 KB 859.4 KB -84.68%
❌ Memory benchmark "asset-modules-inline", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 383.1 KB 804.5 KB -52.38%
❌ Memory benchmark "many-modules-esm", scenario '{"name":"mode-development","mode":"development"}' 1.1 MB 1.9 MB -39.48%
❌ Memory benchmark "asset-modules-source", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 188.3 KB 247.5 KB -23.91%
❌ Memory benchmark "wasm-modules-async", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 188.9 KB 246.6 KB -23.38%
⚡ Memory benchmark "lodash", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 850.9 KB 129.4 KB ×6.6
⚡ Memory benchmark "asset-modules-bytes", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 887.3 KB 248.1 KB ×3.6
⚡ Memory benchmark "wasm-modules-sync", scenario '{"name":"mode-development-rebuild","mode":"development","watch":true}' 358.6 KB 145.5 KB ×2.5

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing test/webpack-cli-bun (c479263) with main (bb9ccfd)

Open in CodSpeed

The pure-JS stand-in reached the ESM harness, whose modules link into
native SourceTextModule graphs and were rejected (asset-modules
webpack-ignore). Dispatch on the creator: only jest-runtime wrappers
get the stand-in.
Copilot AI review requested due to automatic review settings July 4, 2026 18:55

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 4 comments.

Comment thread test/bun-preload.js
Comment on lines +29 to +43
constructor(exportNames, evaluationCallback, options = {}) {
this.identifier = options.identifier || "";
this.context = options.context;
this.status = "unlinked";
this.error = undefined;
this._evaluationCallback = evaluationCallback;
this._namespace = Object.create(null);
Object.defineProperty(this._namespace, Symbol.toStringTag, {
value: "Module"
});
}

setExport(name, value) {
this._namespace[name] = value;
}
Comment thread test/bun-preload.js Outdated
Comment on lines +23 to +27
// Bun segfaults while jest drives a native `vm.SyntheticModule` (its CJS/core
// wrapper for dynamic `import()`) through link/evaluate inside the jest
// environment context. Substitute a pure-JS stand-in with the same lifecycle
// API — jest's resolution/mocks/process globals still apply, but no native vm
// module code runs.
Comment thread test/bun-preload.js Outdated
Comment on lines +66 to +69
// Only jest-runtime's wrappers get the stand-in: they stay in JS and the
// dynamic-import boundary below unwraps them to a namespace. Any other
// creator (e.g. the ESM test harness) links the module into a native
// SourceTextModule graph, which requires a real native instance.
Comment thread test/patches/webpack-cli+7.1.0.patch Outdated
Comment on lines +10 to +12
+ // webpack: Bun honors __esModule and unwraps once already; the upstream
+ // double `.default` is Node-only interop. Drop with this patch file when
+ // a webpack-cli release ships the fix.
Copilot AI review requested due to automatic review settings July 4, 2026 20:03
@github-actions

github-actions Bot commented Jul 4, 2026

Copy link
Copy Markdown
Contributor

Types Coverage

Coverage after merging test/webpack-cli-bun into main will be
99.36%
Coverage Report
FileStmtsBranchesFuncsLinesUncovered Lines
bin
   webpack.js98.77%100%100%98.77%91
examples
   build-common.js100%100%100%100%
   buildAll.js100%100%100%100%
   examples.js100%100%100%100%
   template-common.js98.21%100%100%98.21%72
examples/custom-javascript-parser
   test.filter.js100%100%100%100%
examples/custom-javascript-parser/internals
   acorn-parse.js100%100%100%100%
   meriyah-parse.js100%100%100%100%
   oxc-parse.js91.30%100%100%91.30%140, 142–143, 145, 147, 153–154, 161, 168, 90
examples/markdown
   webpack.config.mjs100%100%100%100%
examples/module-federation
   test.filter.js100%100%100%100%
examples/reexport-components
   test.filter.js100%100%100%100%
examples/typescript
   test.filter.js100%100%100%100%
examples/typescript-non-erasable
   test.filter.js50%100%100%50%5
examples/virtual-modules
   test.filter.js100%100%100%100%
examples/wasm-bindgen-esm
   test.filter.js100%100%100%100%
examples/wasm-complex
   test.filter.js100%100%100%100%
examples/wasm-emscripten
   test.filter.js100%100%100%100%
examples/wasm-simple
   test.filter.js100%100%100%100%
examples/wasm-simple-source-phase
   test.filter.js100%100%100%100%
lib
   APIPlugin.js100%100%100%100%
   AsyncDependenciesBlock.js100%100%100%100%
   AutomaticPrefetchPlugin.js100%100%100%100%
   BannerPlugin.js100%100%100%100%
   Cache.js98.21%100%100%98.21%101
   CacheFacade.js100%100%100%100%
   Chunk.js99.72%100%100%99.72%39
   ChunkGraph.js100%100%100%100%
   ChunkGroup.js100%100%100%100%
   ChunkTemplate.js100%100%100%100%
   CircularModulesPlugin.js98.81%100%100%98.81%136
   CleanPlugin.js99.12%100%100%99.12%207, 227
   CodeGenerationResults.js100%100%100%100%
   CompatibilityPlugin.js100%100%100%100%
   Compilation.js98.43%100%100%98.43%1638, 1957, 1964, 1972, 1994, 1997, 2936, 3415–3416, 3448, 4114, 4144, 4197–4198, 4202, 4207, 4223–4224, 4238–4239, 4244–4245, 4722, 4748, 526, 531, 5556, 5588, 5605, 5621, 5637, 5652, 5677–5678, 5680, 6008, 6013, 6019, 6022, 6034, 6036, 6040, 6056, 6071, 6103, 6157, 6181, 6295, 777–778
   Compiler.js99.56%100%100%99.56%1147–1148, 1156
   ConcatenationScope.js98.65%100%100%98.65%195
   ConditionalInitFragment.js100%100%100%100%
   ConstPlugin.js100%100%100%100%
   ContextExclusionPlugin.js100%100%100%100%
   ContextModule.js100%100%100%100%
   ContextModuleFactory.js97.40%100%100%97.40%258, 395, 418, 420, 424, 433–434
   ContextReplacementPlugin.js100%100%100%100%
   DefinePlugin.js98.99%100%100%98.99%172–173, 189, 208, 282
   DependenciesBlock.js100%100%100%100%
   Dependency.js98.51%100%100%98.51%479, 525
   DependencyTemplate.js100%100%100%100%
   DependencyTemplates.js100%100%100%100%
   DotenvPlugin.js98.41%100%100%98.41%378, 391–392
   DynamicEntryPlugin.js100%100%100%100%
   EntryOptionPlugin.js100%100%100%100%
   EntryPlugin.js100%100%100%100%
   Entrypoint.js100%100%100%100%
   EnvironmentPlugin.js97.14%100%100%97.14%49
   ErrorHelpers.js100%100%100%100%
   EvalDevToolModulePlugin.js100%100%100%100%
   EvalSourceMapDevToolPlugin.js100%100%100%100%
   ExportsInfo.js100%100%100%100%
   ExportsInfoApiPlugin.js100%100%100%100%
   ExternalModule.js98.55%100%100%98.55%1100, 1103, 502–506, 508, 654
   ExternalModuleFactoryPlugin.js100%100%100%100%
   ExternalsPlugin.js100%100%100%100%
   FileSystemInfo.js99.52%100%100%99.52%182, 2382–2383, 2386, 2397, 2408, 2419, 280, 3823, 3838, 3862
   FlagAllModulesAsUsedPlugin.js100%100%100%100%
   FlagDependencyExportsPlugin.js98.21%100%100%98.21%448, 457, 460, 464, 476
   FlagDependencyUsagePlugin.js100%100%100%100%
   FlagEntryExportAsUsedPlugin.js100%100%100%100%
   Generator.js100%100%100%100%
   HotModuleReplacementPlugin.js100%100%100%100%
   HotUpdateChunk.js100%100%100%100%
   IgnorePlugin.js100%100%100%100%
   IgnoreWarningsPlugin.js100%100%100%100%
   InitFragment.js100%100%100%100%
   JavascriptMetaInfoPlugin.js100%100%100%100%
   LazyBarrel.js100%100%100%100%
   LibraryTemplatePlugin.js100%100%100%100%
   LoaderOptionsPlugin.js100%100%100%100%
   LoaderTargetPlugin.js100%100%100%100%
   MainTemplate.js100%100%100%100%
   ManifestPlugin.js100%100%100%100%
   Module.js98.50%100%100%98.50%1285, 1290, 1350, 1364, 1426, 1435
   ModuleFactory.js100%100%100%100%
   ModuleFilenameHelpers.js98.85%100%100%98.85%106, 108
   ModuleGraph.js99.73%100%100%99.73%1005
   ModuleGraphConnection.js100%100%100%100%
   ModuleInfoHeaderPlugin.js100%100%100%100%
   ModuleNotFoundError.js100%100%100%100%
   ModuleProfile.js100%100%100%100%
   ModuleSourceTypeConstants.js100%100%100%100%
   ModuleTemplate.js100%100%100%100%
   ModuleTypeConstants.js100%100%100%100%
   MultiCompiler.js99.69%100%100%99.69%661
   MultiStats.js100%100%100%100%
   MultiWatching.js100%100%100%100%
   NoEmitOnErrorsPlugin.js100%100%100%100%
   NodeStuffPlugin.js100%100%100%100%
   NormalModule.js97.89%100%100%97.89%1223, 1226, 1243, 1260, 1507, 1541, 1557, 1644, 2000, 2299, 2304–2314, 415, 419, 573
   NormalModuleFactory.js99.47%100%100%99.47%1083, 1392, 486, 498
   NormalModuleReplacementPlugin.js100%100%100%100%
   NullFactory.js100%100%100%100%
   OptimizationStages.js100%100%100%100%
   OptionsApply.js100%100%100%100%
   Parser.js100%100%100%100%
   PlatformPlugin.js100%100%100%100%
   PrefetchPlugin.js100%100%100%100%
   ProgressPlugin.js98.85%100%100%98.85%527–528, 533, 535, 599
   ProvidePlugin.js100%100%100%100%
   RawModule.js100%100%100%100%
   RecordIdsPlugin.js100%100%100%100%
   RequestShortener.js100%100%100%100%
   ResolverFactory.js100%100%100%100%
   RuntimeGlobals.js100%100%100%100%
   RuntimeModule.js100%100%100%100%
   RuntimePlugin.js100%100%100%100%
   RuntimeTemplate.js100%100%100%100%
   SelfModuleFactory.js100%100%100%100%
   SingleEntryPlugin.js100%100%100%100%
   SourceMapDevToolModuleOptionsPlugin.js100%100%100%100%
   SourceMapDevToolPlugin.js98.62%100%100%98.62%220, 224, 226, 419, 430, 889
   Stats.js100%100%100%100%
   Template.js100%100%100%100%
   TemplatedPathPlugin.js99.43%100%100%99.43%308–309
   UseStrictPlugin.js100%100%100%100%
   WarnCaseSensitiveModulesPlugin.js100%100%100%100%
   WarnDeprecatedOptionPlugin.js100%100%100%100%
   WarnNoModeSetPlugin.js100%100%100%100%
   WatchIgnorePlugin.js100%100%100%100%
   Watching.js100%100%100%100%
   WebpackError.js100%100%100%100%
   WebpackIsIncludedPlugin.js100%100%100%100%
   WebpackOptionsApply.js100%100%100%100%
   WebpackOptionsDefaulter.js100%100%100%100%
   buildChunkGraph.js99.87%100%100%99.87%371
   cli.js98.63%100%100%98.63%10, 119, 549, 581, 631, 905
   index.js99.72%100%100%99.72%184
   validateSchema.js94.67%100%100%94.67%100, 87, 89, 98
   webpack.js96.33%100%100%96.33%10, 198, 220, 222
lib/asset
   AssetBytesGenerator.js100%100%100%100%
   AssetBytesParser.js100%100%100%100%
   AssetGenerator.js100%100%100%100%
   AssetModule.js100%100%100%100%
   AssetModulesPlugin.js97.33%100%100%97.33%282, 306, 309, 36, 362, 41
   AssetParser.js100%100%100%100%
   AssetSourceGenerator.js100%100%100%100%
   AssetSourceParser.js100%100%100%100%
   RawDataUrlModule.js100%100%100%100%
lib/async-modules
   AsyncModuleHelpers.js100%100%100%100%
   AwaitDependenciesInitFragment.js100%100%100%100%
   InferAsyncModulesPlugin.js100%100%100%100%
lib/bun
   BunTargetPlugin.js100%100%100%100%
lib/cache
   AddBuildDependenciesPlugin.js100%100%100%100%
   AddManagedPathsPlugin.js100%100%100%100%
   IdleFileCachePlugin.js97.92%100%100%97.92%75, 87, 95
   MemoryCachePlugin.js95.83%100%100%95.83%33
   MemoryWithGcCachePlugin.js93.15%100%100%93.15%107, 114–115, 123, 90
   PackFileCacheStrategy.js96.40%100%100%96.40%1251, 1351, 1355, 1417, 628, 647, 657–659, 661, 677–678, 683, 686, 688, 693, 698, 723, 729, 763, 769, 775, 780, 791, 800, 805–806, 808, 825, 831–832, 834
   ResolverCachePlugin.js100%100%100%100%
   getLazyHashedEtag.js100%100%100%100%
   mergeEtags.js100%100%100%100%
lib/config
   browserslistTargetHandler.js100%100%100%100%
   defaults.js99.33%100%100%99.33%1468–1470, 1478,

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated no new comments.

@alexander-akait
alexander-akait merged commit 413b0be into main Jul 4, 2026
64 checks passed
@alexander-akait
alexander-akait deleted the test/webpack-cli-bun branch July 4, 2026 20:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants