Package evaluation to test Gremlins on Julia 1.14.0-DEV.2468 (92be8bc088*) started at 2026-07-06T03:03:13.855 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 14.21s ################################################################################ # Installation # Installing Gremlins... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [8bb2f624] + Gremlins v0.4.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [8bb2f624] + Gremlins v0.4.0 [70703baa] + JuliaSyntax v1.0.2 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] + LibCURL_jll v8.20.0+1 [e37daf67] + LibGit2_jll v1.9.4+0 [29816b5a] + LibSSH2_jll v1.11.101+0 [14a3606d] + MozillaCACerts_jll v2026.5.14 [458c3c95] + OpenSSL_jll v3.5.7+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850ede] + nghttp2_jll v1.69.0+0 [3f19e933] + p7zip_jll v17.8.0+0 Installation completed after 1.11s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Warning: Ignoring incompatible compat entry `SHA = "0.7.0"` in "/tmp/jl_jEjJ9Q/Project.toml". │ SHA is a non-upgradable standard library with version 1.13.0 in the current Julia version. │ Fix by setting compat to "0.7.0, 1" to mark support of the current version 1.13.0. └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:520 Precompiling package dependencies... Precompiling project... 6.6 s ✓ Gremlins 1 dependency successfully precompiled in 7 seconds. 31 already precompiled. Precompilation completed after 28.95s ################################################################################ # Testing # Testing Gremlins ┌ Warning: Ignoring incompatible compat entry `SHA = "0.7.0"` in "/tmp/jl_sBKaF2/Project.toml". │ SHA is a non-upgradable standard library with version 1.13.0 in the current Julia version. │ Fix by setting compat to "0.7.0, 1" to mark support of the current version 1.13.0. └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:520 Status `/tmp/jl_sBKaF2/Project.toml` [8bb2f624] Gremlins v0.4.0 [70703baa] JuliaSyntax v1.0.2 [2a0f44e3] Base64 v1.11.0 [44cfe95a] Pkg v1.14.0 [ea8e919c] SHA v1.13.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 Status `/tmp/jl_sBKaF2/Manifest.toml` [8bb2f624] Gremlins v0.4.0 [70703baa] JuliaSyntax v1.0.2 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.5+2 [deac9b47] LibCURL_jll v8.20.0+1 [e37daf67] LibGit2_jll v1.9.4+0 [29816b5a] LibSSH2_jll v1.11.101+0 [14a3606d] MozillaCACerts_jll v2026.5.14 [458c3c95] OpenSSL_jll v3.5.7+0 [efcefdf7] PCRE2_jll v10.47.0+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850ede] nghttp2_jll v1.69.0+0 [3f19e933] p7zip_jll v17.8.0+0 Testing Running tests... [smoke] Self-mutate: discovered 3742 mutation sites in src/ Test Summary: | Pass Total Time Gremlins M0 | 259 259 56.8s Test Summary: | Pass Total Time Gremlins M1 | 68 68 5m35.9s [warm_ok count=1, total=1] [killed via warm eval: 1] [survived via warm eval: 1] [const sites statically classified: 4] [warm_ok=1, worker_recycles=0] [avg warm time for survived: 3.234s] ━━━ Gremlins Warm Mutation Report ━━━━━━━━━━━━━━ Package : MiniTarget Score : 100.0% (killed=1 / eligible=1) Effective : 100.0% (killed=1 / reachable=1) [uncovered counts against] ⚠ perfect score but the suite was barely challenged (only 1 eligible site(s); kills from only 1 operator(s)) — widen operators / coverage before trusting this Killed : 1 Survived : 0 Timeout : 0 NoCov : 0 Error : 0 Total : 1 Cache hits : 0 Warm-executed : 1 Cold fallback : 0 Worker recycles: 0 Baseline : 14.11s Runtime : 27.48s ── Fallback taxonomy ── warm_ok : 1 ── I4 agreement (1 sampled) ── OK — all 1 warm results agree with cold re-runs ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ Test Summary: | Pass Total Time Gremlins M2 | 110 110 37.7s Test Summary: | Pass Total Time CLI — arg parsing | 36 36 0.4s Test Summary: | Pass Total Time CLI parse — --blame flag | 2 2 0.0s Test Summary: | Pass Total Time CLI — band classification | 14 14 0.0s Test Summary: | Pass Total Time CLI — exit codes | 3 3 0.0s Test Summary: | Pass Total Time CLI — band line format | 7 7 0.0s Test Summary: | Pass Total Time CLI — path normalization | 6 6 0.0s Test Summary: | Pass Total Time CLI — file filter | 11 11 0.2s Test Summary: | Pass Total Time M2.1 Papercuts | 54 54 5m39.3s Test Summary: | Pass Total Time parse_diff_hunks | 5 5 0.6s Test Summary: | Pass Total Time scope_to_diff | 4 4 0.4s Test Summary: | Pass Total Time discover with diff_lines | 3 3 0.6s Test Summary: | Pass Total Time OP_COMPARISON_CHAIN | 3 3 0.1s Test Summary: | Pass Total Time OP_COMPARISON_CHAIN falsifiability | 2 2 0.0s Test Summary: | Pass Total Time OP_TERNARY_SWAP | 2 2 0.0s Test Summary: | Pass Total Time OP_TERNARY_SWAP falsifiability | 1 1 0.0s Test Summary: | Pass Total Time OP_BROADCAST_DROP | 4 4 0.1s Test Summary: | Pass Total Time OP_BROADCAST_DROP falsifiability | 1 1 0.2s Test Summary: | Pass Total Time operators on multibyte source | 4 4 0.1s Test Summary: | Pass Total Time schema_eligible | 5 5 0.2s Test Summary: | Pass Total Time instrument_function | 3 3 2.4s Test Summary: | Pass Total Time instrument baseline is observationally original | 3 3 0.0s Test Summary: | Pass Total Time disjoint_eligible routes nested sites to warm | 2 2 0.2s Test Summary: | Pass Total Time run_mutations_schema end-to-end | 7 7 32.8s Test Summary: | Pass Total Time reinstrument! fail-closed: _instrument_via_worker dead worker returns false | 2 2 5.1s Test Summary: | Pass Total Time schema/warm agreement + hot-path guard | 16 16 1m48.3s Test Summary: | Pass Total Time AgreementResult: empty sample returns zeros | 7 7 11.6s Test Summary: | Pass Total Time _check_agreement: real kill↔survive divergence throws MutationError | 12 12 0.1s Test Summary: | Pass Total Time schema_warm_agreement: infrastructure outcomes do not fire the guard | 1 1 32.3s Test Summary: | Pass Total Time run_mutations_schema: auto_disabled field present | 6 6 58.4s Test Summary: | Pass Total Time print_summary: contains schema/warm split | 3 3 24.1s Test Summary: | Pass Total Time report_markdown: contains schema/warm split | 4 4 24.8s Test Summary: | Pass Total Time print_summary: auto-disable line present when fired | 4 4 24.0s Test Summary: | Pass Total Time CLI --schema flag: ParsedArgs.schema parsed correctly | 9 9 0.1s Test Summary: | Pass Total Time run_mutations_schema: cmp_chain extras fall back to warm | 1 1 0.4s Test Summary: | Pass Total Time Dispatch operators (v1) | 35 35 2.5s Test Summary: | Pass Total Time detect_units — split prelude / include-units / inline | 12 12 3.1s Test Summary: | Pass Total Time _is_test_unit — filename gate | 4 4 0.4s Test Summary: | Pass Total Time per_unit_coverage — line attributed to the covering unit only | 8 8 19.8s Test Summary: | Pass Total Time per_unit_coverage — broken unit recorded as failed, never crashes | 3 3 26.4s Test Summary: | Pass Total Time _join_blame — attribution, multi-blame, unattributed, failed | 5 5 2.2s Test Summary: | Pass Total Time render_blame — deterministic section text | 6 6 0.4s Test Summary: | Pass Total Time blame fixture — §5 falsifiability (a/b/c) | 8 8 3m28.4s Test Summary: | Pass Total Time _drop_unsupported_source_deps! gates [sources] by Julia version | 9 9 0.3s Test Summary: | Pass Total Time Test-env deps (#2/#3) | 16 16 5m20.8s Test Summary: | Pass Total Time render_survivor_diffs — basic hunk structure | 6 6 1.6s Test Summary: | Pass Total Time render_survivor_diffs — empty when no survivors | 2 2 0.4s Test Summary: | Pass Total Time detect_units — ReTestItems layout, two _test.jl files detected | 8 8 0.4s ┌ Warning: detect_units: ReTestItems/TestItemRunner layout detected in /tmp/jl_AahRb5/test/runtests.jl but no *_test.jl / *_tests.jl files found under /tmp/jl_AahRb5/test or /tmp/jl_AahRb5/src. Per-file blame is unsupported for this layout — all survivors will be unattributed. └ @ Gremlins ~/.julia/packages/Gremlins/m29K3/src/blame.jl:167 Test Summary: | Pass Total Time detect_units — ReTestItems layout, no _test.jl files → zero units | 1 1 0.4s Test Summary: | Pass Total Time detect_units — classic include layout still works (regression) | 3 3 0.5s ┌ Warning: detect_units: ReTestItems/TestItemRunner layout detected in /tmp/jl_4RAcJB/test/runtests.jl but no *_test.jl / *_tests.jl files found under /tmp/jl_4RAcJB/test. Per-file blame is unsupported for this layout — all survivors will be unattributed. └ @ Gremlins ~/.julia/packages/Gremlins/m29K3/src/blame.jl:167 Test Summary: | Pass Total Time detect_units — src-collocated _test.jl enumerated via pkg_src_dir | 4 4 0.4s Test Summary: | Pass Total Time detect_units — @run_package_tests layout detected as ReTestItems | 2 2 0.4s Test Summary: | Pass Total Time Gremlins parallel — kwarg accepted | 1 1 20.7s Test Summary: | Pass Total Time Gremlins parallel — parallel==sequential outcomes | 14 14 36.6s Test Summary: | Pass Total Time Gremlins parallel — sequential regression (parallel=1 unchanged) | 2 2 20.7s Test Summary: | Pass Total Time Gremlins parallel — no_coverage sites handled correctly | 12 12 2m24.2s Testing Gremlins tests passed Testing completed after 1822.02s PkgEval succeeded after 2229.03s