Package evaluation to test Cthulhu on Julia 1.12.7-DEV.42 (6f510b6086*) started at 2026-06-19T12:48:45.121 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.5s ################################################################################ # Installation # Installing Cthulhu... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [f68482b8] + Cthulhu v3.0.2 Updating `~/.julia/environments/v1.12/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [7d9f7c33] + Accessors v0.1.44 [da1fd8a2] + CodeTracking v3.0.2 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [f68482b8] + Cthulhu v3.0.2 [1eca21be] + FoldingTrees v1.2.2 [3587e190] + InverseFunctions v0.1.17 [70703baa] + JuliaSyntax v1.0.2 [1914dd2f] + MacroTools v0.5.16 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [d265eb64] + TypedSyntax v1.5.4 [b8c1c048] + WidthLimitedIO v1.0.1 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [d6f4376e] + Markdown v1.11.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 Installation completed after 5.8s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 18.78s ################################################################################ # Testing # Testing Cthulhu Status `/tmp/jl_l6nYGb/Project.toml` [7d9f7c33] Accessors v0.1.44 [da1fd8a2] CodeTracking v3.0.2 [807dbc54] Compiler v0.1.1 [f68482b8] Cthulhu v3.0.2 [ab62b9b5] DeepDiffs v1.2.0 [1eca21be] FoldingTrees v1.2.2 [70703baa] JuliaSyntax v1.0.2 [dc46b164] PerformanceTestTools v0.1.3 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [295af30f] Revise v3.15.1 [90137ffa] StaticArrays v1.9.18 [d265eb64] TypedSyntax v1.5.4 [b8c1c048] WidthLimitedIO v1.0.1 [b77e0a4c] InteractiveUtils v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 Status `/tmp/jl_l6nYGb/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [7d9f7c33] Accessors v0.1.44 [da1fd8a2] CodeTracking v3.0.2 [807dbc54] Compiler v0.1.1 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [f68482b8] Cthulhu v3.0.2 [ab62b9b5] DeepDiffs v1.2.0 [1eca21be] FoldingTrees v1.2.2 [3587e190] InverseFunctions v0.1.17 [aa1ae85d] JuliaInterpreter v0.10.12 [70703baa] JuliaSyntax v1.0.2 [6f1432cf] LoweredCodeUtils v3.6.0 [1914dd2f] MacroTools v0.5.16 [bac558e1] OrderedCollections v2.0.0 [dc46b164] PerformanceTestTools v0.1.3 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [295af30f] Revise v3.15.1 [90137ffa] StaticArrays v1.9.18 [1e83bf80] StaticArraysCore v1.4.4 [d265eb64] TypedSyntax v1.5.4 [b8c1c048] WidthLimitedIO v1.0.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [8bf52ea8] CRC32c v1.11.0 [ade2ca70] Dates v1.11.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.6+0 [8e850b90] libblastrampoline_jll v5.15.0+0 Testing Running tests... ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: Using syntax highlighter `pygmentize -l`. [ Info: Turned off syntax highlighter for Julia, LLVM and native code. ┌ Warning: Could not retrieve AST of simplef(a, b) @ Main.test_terminal ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:49. AST display requires Revise.jl to be loaded. └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/codeview.jl:62 [ Info: Dumping inference cache. Terminal: Test Failed at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 Expression: occursin("$(warncolor)%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", displayed) Evaluated: occursin("\e[33m%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", "callfmulti(c) @ Main.test_terminal.Definitions ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19\nVariables\n #self#\e[36m::Const(Main.test_terminal.Definitions.callfmulti)\e[39m\n c\e[91m\e[1m::Any\e[22m\e[39m\n\nBody\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n \e[33m @ /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19 within `unknown scope`\e[39m\n\e[90m1 ─\e[39m %1 = Main.test_terminal.Definitions.fmulti\e[36m::Const(Main.test_terminal.Definitions.fmulti)\e[39m\n\e[90m│ \e[39m %2 = \e[33m dynamic \e[39mBase.getindex(c)\e[91m\e[1m::Any\e[22m\e[39m\n\e[90m│ \e[39m %3 = \e[33m dynamic \e[39m(%1)(%2)\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n\e[90m└──\e[39m return %3\n\n\e[34mSelect a call to descend into or ↩ to ascend.\e[39m\n\n\e[36mToggles\e[39m: [\e[32m\e[1mw\e[22m\e[39m]arn, [\e[31mh\e[39m]ide type-stable statements, [\e[31mo\e[39m]ptimize, [\e[90md\e[39m]ebuginfo, [\e[31mr\e[39m]emarks, [\e[31me\e[39m]ffects, e[\e[31mx\e[39m]ception_types, [\e[31mi\e[39m]nlining costs, [\e[32m\e[1mt\e[22m\e[39m]ype_annotations, [\e[31ms\e[39m]yntax highlight for Source/LLVM/Native, [\e[31mj\e[39m]ump to source always.\n\e[36mShow\e[39m: [\e[31mS\e[39m]ource, [\e[31mA\e[39m]ST, [\e[32m\e[1mT\e[22m\e[39m]yped, [\e[31mL\e[39m]LVM, [\e[31mN\e[39m]ative.\n\e[36mActions\e[39m: [\e[36mq\e[39m]uit, \e[36m⟵\e[39m ascend, [\e[36mb\e[39m]ookmark, [\e[36mE\e[39m]dit source code, [\e[36mR\e[39m]evise and redisplay, dum[\e[36mP\e[39m] params cache.\n\n\e[2K • %2 = runtime < getindex(::Any)::Any >\r\n\e[2K %3 = call → fmulti(::Any)::Union{Float32, Int64}\r\n\e[2K ↩") Stacktrace: [1] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:56 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] ┌ Info: Inference didn't analyze this call because it is a dynamic call: └ Cthulhu nevertheless is trying to descend into it for further inspection. ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: This method only fills in default arguments; descend into the body method to see the full source. Precompiling packages... 19973.7 ms ✓ Revise 1 dependency successfully precompiled in 20 seconds. 23 already precompiled. 14 dependencies precompiled but different versions are currently loaded (Base64, CodeTracking, Compiler, Dates, InteractiveUtils, JuliaSyntaxHighlighting, Markdown, Preferences, Printf, REPL, StyledStrings, TOML, UUIDs and Unicode). Restart julia to access the new versions. Otherwise, 4 dependents of these packages may trigger further precompilation to work with the unexpected versions. [ Info: Using syntax highlighter `pygmentize -l`. [ Info: Turned off syntax highlighter for Julia, LLVM and native code. [ Info: Dumping inference cache. Terminal: Test Failed at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 Expression: occursin("$(warncolor)%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", displayed) Evaluated: occursin("\e[33m%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", "callfmulti(c) @ Main.test_terminal.Definitions ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19\nVariables\n #self#\e[36m::Const(Main.test_terminal.Definitions.callfmulti)\e[39m\n c\e[91m\e[1m::Any\e[22m\e[39m\n\nBody\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n \e[33m @ /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19 within `unknown scope`\e[39m\n\e[90m1 ─\e[39m %1 = Main.test_terminal.Definitions.fmulti\e[36m::Const(Main.test_terminal.Definitions.fmulti)\e[39m\n\e[90m│ \e[39m %2 = \e[33m dynamic \e[39mBase.getindex(c)\e[91m\e[1m::Any\e[22m\e[39m\n\e[90m│ \e[39m %3 = \e[33m dynamic \e[39m(%1)(%2)\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n\e[90m└──\e[39m return %3\n\n\e[34mSelect a call to descend into or ↩ to ascend.\e[39m\n\n\e[36mToggles\e[39m: [\e[32m\e[1mw\e[22m\e[39m]arn, [\e[31mh\e[39m]ide type-stable statements, [\e[31mo\e[39m]ptimize, [\e[90md\e[39m]ebuginfo, [\e[31mr\e[39m]emarks, [\e[31me\e[39m]ffects, e[\e[31mx\e[39m]ception_types, [\e[31mi\e[39m]nlining costs, [\e[32m\e[1mt\e[22m\e[39m]ype_annotations, [\e[31ms\e[39m]yntax highlight for Source/LLVM/Native, [\e[31mj\e[39m]ump to source always.\n\e[36mShow\e[39m: [\e[31mS\e[39m]ource, [\e[31mA\e[39m]ST, [\e[32m\e[1mT\e[22m\e[39m]yped, [\e[31mL\e[39m]LVM, [\e[31mN\e[39m]ative.\n\e[36mActions\e[39m: [\e[36mq\e[39m]uit, \e[36m⟵\e[39m ascend, [\e[36mb\e[39m]ookmark, [\e[36mE\e[39m]dit source code, [\e[36mR\e[39m]evise and redisplay, dum[\e[36mP\e[39m] params cache.\n\n\e[2K • %2 = runtime < getindex(::Any)::Any >\r\n\e[2K %3 = call → fmulti(::Any)::Union{Float32, Int64}\r\n\e[2K ↩") Stacktrace: [1] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:56 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [3] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] ┌ Info: Inference didn't analyze this call because it is a dynamic call: └ Cthulhu nevertheless is trying to descend into it for further inspection. [ Info: tracking LinearAlgebra [ Info: skipped test_irshow.jl Test Summary: | Pass Fail Broken Total Time Cthulhu.jl | 1283 2 4 1289 9m19.9s Core functionality | 230 1 231 4m09.1s Code view | 85 85 14.7s Provider functionality | 229 229 1m23.6s Terminal tests | 91 1 92 34.5s Terminal | 91 1 92 33.5s Source discarded because of LimitedAccuracy (#642) | 2 2 1.7s Code instances from [semi-]concrete evaluation (#609, #610) | 2 2 3.2s Bookmarks | 9 9 4.4s AbstractInterpreter | 1 1 0.6s Tests with Compiler extension loaded | 647 1 3 651 2m57.3s Core functionality | 230 1 231 52.1s Code view | 91 91 1m36.3s Provider functionality | 229 229 11.3s Terminal tests | 96 1 2 99 17.1s Terminal | 96 1 2 99 16.0s Source discarded because of LimitedAccuracy (#642) | 2 2 1.0s Code instances from [semi-]concrete evaluation (#609, #610) | 2 2 7.6s Bookmarks | 9 9 1.2s AbstractInterpreter | 1 1 0.4s RNG of the outermost testset: Random.Xoshiro(0x28c25e21865ffa70, 0xe2425de0c9c218b6, 0xdc7edfd7b999bcc4, 0x21aaf0337fe52bda, 0x09b0686302eb275c) ERROR: LoadError: Some tests did not pass: 1283 passed, 2 failed, 0 errored, 4 broken. in expression starting at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/runtests.jl:10 Testing failed after 573.05s ERROR: LoadError: Package Cthulhu errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2538 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2387 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:552 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 625.13s: package has test failures