Package evaluation to test Cthulhu on Julia 1.12.4 (422f456051*) started at 2026-01-29T01:41:39.667 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 7.73s ################################################################################ # Installation # Installing Cthulhu... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [f68482b8] + Cthulhu v3.0.2 Updating `~/.julia/environments/v1.12/Manifest.toml` [1520ce14] + AbstractTrees v0.4.5 [7d9f7c33] + Accessors v0.1.43 [da1fd8a2] + CodeTracking v3.0.0 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [f68482b8] + Cthulhu v3.0.2 [1eca21be] + FoldingTrees v1.2.2 [3587e190] + InverseFunctions v0.1.17 [70703baa] + JuliaSyntax v1.0.2 [1914dd2f] + MacroTools v0.5.16 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [d265eb64] + TypedSyntax v1.5.4 [b8c1c048] + WidthLimitedIO v1.0.1 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [d6f4376e] + Markdown v1.11.0 [de0858da] + Printf v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 Installation completed after 4.51s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 17.44s ################################################################################ # Testing # Testing Cthulhu Status `/tmp/jl_83SdJy/Project.toml` [7d9f7c33] Accessors v0.1.43 [da1fd8a2] CodeTracking v3.0.0 [807dbc54] Compiler v0.1.1 [f68482b8] Cthulhu v3.0.2 [ab62b9b5] DeepDiffs v1.2.0 [1eca21be] FoldingTrees v1.2.2 [70703baa] JuliaSyntax v1.0.2 [dc46b164] PerformanceTestTools v0.1.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [295af30f] Revise v3.13.2 [90137ffa] StaticArrays v1.9.16 [d265eb64] TypedSyntax v1.5.4 [b8c1c048] WidthLimitedIO v1.0.1 [b77e0a4c] InteractiveUtils v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 Status `/tmp/jl_83SdJy/Manifest.toml` [1520ce14] AbstractTrees v0.4.5 [7d9f7c33] Accessors v0.1.43 [da1fd8a2] CodeTracking v3.0.0 [807dbc54] Compiler v0.1.1 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [f68482b8] Cthulhu v3.0.2 [ab62b9b5] DeepDiffs v1.2.0 [1eca21be] FoldingTrees v1.2.2 [3587e190] InverseFunctions v0.1.17 [aa1ae85d] JuliaInterpreter v0.10.9 [70703baa] JuliaSyntax v1.0.2 [6f1432cf] LoweredCodeUtils v3.5.0 [1914dd2f] MacroTools v0.5.16 [bac558e1] OrderedCollections v1.8.1 [dc46b164] PerformanceTestTools v0.1.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [295af30f] Revise v3.13.2 [90137ffa] StaticArrays v1.9.16 [1e83bf80] StaticArraysCore v1.4.4 [d265eb64] TypedSyntax v1.5.4 [b8c1c048] WidthLimitedIO v1.0.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.4+0 [8e850b90] libblastrampoline_jll v5.15.0+0 Testing Running tests... Precompiling packages... 5185.9 ms ✓ Accessors → StaticArraysExt 1 dependency successfully precompiled in 6 seconds. 18 already precompiled. ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: Using syntax highlighter `pygmentize -l`. [ Info: Turned off syntax highlighter for Julia, LLVM and native code. ┌ Warning: Could not retrieve AST of simplef(a, b) @ Main.test_terminal ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:49. AST display requires Revise.jl to be loaded. └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/codeview.jl:62 [ Info: Dumping inference cache. Terminal: Test Failed at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 Expression: occursin("$(warncolor)%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", displayed) Evaluated: occursin("\e[33m%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", "callfmulti(c) @ Main.test_terminal.Definitions ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19\nVariables\n #self#\e[36m::Const(Main.test_terminal.Definitions.callfmulti)\e[39m\n c\e[91m\e[1m::Any\e[22m\e[39m\n\nBody\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n \e[33m @ /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19 within `unknown scope`\e[39m\n\e[90m1 ─\e[39m %1 = Main.test_terminal.Definitions.fmulti\e[36m::Const(Main.test_terminal.Definitions.fmulti)\e[39m\n\e[90m│ \e[39m %2 = \e[33m dynamic \e[39mBase.getindex(c)\e[91m\e[1m::Any\e[22m\e[39m\n\e[90m│ \e[39m %3 = \e[33m dynamic \e[39m(%1)(%2)\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n\e[90m└──\e[39m return %3\n\n\e[34mSelect a call to descend into or ↩ to ascend.\e[39m\n\n\e[36mToggles\e[39m: [\e[32m\e[1mw\e[22m\e[39m]arn, [\e[31mh\e[39m]ide type-stable statements, [\e[31mo\e[39m]ptimize, [\e[90md\e[39m]ebuginfo, [\e[31mr\e[39m]emarks, [\e[31me\e[39m]ffects, e[\e[31mx\e[39m]ception_types, [\e[31mi\e[39m]nlining costs, [\e[32m\e[1mt\e[22m\e[39m]ype_annotations, [\e[31ms\e[39m]yntax highlight for Source/LLVM/Native, [\e[31mj\e[39m]ump to source always.\n\e[36mShow\e[39m: [\e[31mS\e[39m]ource, [\e[31mA\e[39m]ST, [\e[32m\e[1mT\e[22m\e[39m]yped, [\e[31mL\e[39m]LVM, [\e[31mN\e[39m]ative.\n\e[36mActions\e[39m: [\e[36mq\e[39m]uit, \e[36m⟵\e[39m ascend, [\e[36mb\e[39m]ookmark, [\e[36mE\e[39m]dit source code, [\e[36mR\e[39m]evise and redisplay, dum[\e[36mP\e[39m] params cache.\n\n\e[2K • %2 = runtime < getindex(::Any)::Any >\r\n\e[2K %3 = call → fmulti(::Any)::Union{Float32, Int64}\r\n\e[2K ↩") Stacktrace: [1] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:56 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] ┌ Info: Inference didn't analyze this call because it is a dynamic call: └ Cthulhu nevertheless is trying to descend into it for further inspection. ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 ┌ Warning: MethodInstance extraction failed. │ ci.sig = Tuple{Main.test_Cthulhu.var"#only_ints#only_ints##0", Float64} │ ci.rt = Union{} └ @ Cthulhu ~/.julia/packages/Cthulhu/7jFQA/src/compiler/callsite.jl:70 [ Info: This method only fills in default arguments; descend into the body method to see the full source. [ Info: This method only fills in default arguments; descend into the body method to see the full source. `descend`: Error During Test at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:89 Test threw exception Expression: end_terminal_session(harness) AssertionError: wait_for(task) Stacktrace: [1] end_terminal_session(terminal::Cthulhu.Testing.VirtualTerminal, task::Task, io::Cthulhu.Testing.AsyncIO) @ Cthulhu.Testing ~/.julia/packages/Cthulhu/7jFQA/src/testing.jl:210 [2] test_descend_for_provider(::Cthulhu.DefaultProvider, ::Function, ::Vararg{Any}; show::Bool) @ Main.test_provider.Impl ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [3] test_descend_for_provider @ ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [inlined] [4] (::Main.test_provider.var"#5#6"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}})() @ Main.test_provider ./none:-1 [5] with_logstate(f::Main.test_provider.var"#5#6"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [6] with_logger(f::Function, logger::TestLogger) @ Base.CoreLogging ./logging/logging.jl:653 [7] #collect_test_logs#50 @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:126 [inlined] [8] collect_test_logs @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:124 [inlined] [9] match_logs(::Function, ::Tuple{Symbol, String}, ::Vararg{Tuple{Symbol, String}}; match_mode::Symbol, kwargs::@Kwargs{}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:274 [10] match_logs(::Function, ::Tuple{Symbol, String}, ::Vararg{Tuple{Symbol, String}}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:273 [11] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:55 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [13] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:65 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [15] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:65 [inlined] `descend`: Error During Test at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:89 Test threw exception Expression: end_terminal_session(harness) AssertionError: wait_for(task) Stacktrace: [1] end_terminal_session(terminal::Cthulhu.Testing.VirtualTerminal, task::Task, io::Cthulhu.Testing.AsyncIO) @ Cthulhu.Testing ~/.julia/packages/Cthulhu/7jFQA/src/testing.jl:210 [2] test_descend_for_provider(::Main.test_provider.Impl.CountingProviderModule.CountingProvider, ::Function, ::Vararg{Any}; show::Bool) @ Main.test_provider.Impl ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [3] test_descend_for_provider @ ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [inlined] [4] (::Main.test_provider.var"#7#8"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}})() @ Main.test_provider ./none:-1 [5] with_logstate(f::Main.test_provider.var"#7#8"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [6] with_logger(f::Function, logger::TestLogger) @ Base.CoreLogging ./logging/logging.jl:653 [7] #collect_test_logs#50 @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:126 [inlined] [8] collect_test_logs @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:124 [inlined] [9] match_logs(::Function, ::Tuple{Symbol, Regex}, ::Vararg{Any}; match_mode::Symbol, kwargs::@Kwargs{}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:274 [10] match_logs(::Function, ::Tuple{Symbol, Regex}, ::Vararg{Any}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:273 [11] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:55 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [13] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:65 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [15] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:66 [inlined] `descend`: Error During Test at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:89 Test threw exception Expression: end_terminal_session(harness) AssertionError: wait_for(task) Stacktrace: [1] end_terminal_session(terminal::Cthulhu.Testing.VirtualTerminal, task::Task, io::Cthulhu.Testing.AsyncIO) @ Cthulhu.Testing ~/.julia/packages/Cthulhu/7jFQA/src/testing.jl:210 [2] test_descend_for_provider(::Main.test_provider.Impl.OverlayProviderModule.OverlayProvider, ::Function, ::Vararg{Any}; show::Bool) @ Main.test_provider.Impl ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [3] test_descend_for_provider @ ~/.julia/packages/Cthulhu/7jFQA/test/provider_utils.jl:62 [inlined] [4] (::Main.test_provider.var"#9#10"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}})() @ Main.test_provider ./none:-1 [5] with_logstate(f::Main.test_provider.var"#9#10"{Tuple{typeof(Main.test_provider.test_function), Tuple{DataType}}}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [6] with_logger(f::Function, logger::TestLogger) @ Base.CoreLogging ./logging/logging.jl:653 [7] #collect_test_logs#50 @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:126 [inlined] [8] collect_test_logs @ /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:124 [inlined] [9] match_logs(::Function, ::Tuple{Symbol, Regex}, ::Vararg{Any}; match_mode::Symbol, kwargs::@Kwargs{}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:274 [10] match_logs(::Function, ::Tuple{Symbol, Regex}, ::Vararg{Any}) @ Test /opt/julia/share/julia/stdlib/v1.12/Test/src/logging.jl:273 [11] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:55 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [13] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:65 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [15] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_provider.jl:67 [inlined] [ Info: Using syntax highlighter `pygmentize -l`. [ Info: Turned off syntax highlighter for Julia, LLVM and native code. [ Info: Dumping inference cache. Terminal: Test Failed at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 Expression: occursin("$(warncolor)%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", displayed) Evaluated: occursin("\e[33m%\e[39m3 = call → fmulti(::Any)::Union{Float32, Int64}", "callfmulti(c) @ Main.test_terminal.Definitions ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19\nVariables\n #self#\e[36m::Const(Main.test_terminal.Definitions.callfmulti)\e[39m\n c\e[91m\e[1m::Any\e[22m\e[39m\n\nBody\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n \e[33m @ /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:19 within `unknown scope`\e[39m\n\e[90m1 ─\e[39m %1 = Main.test_terminal.Definitions.fmulti\e[36m::Const(Main.test_terminal.Definitions.fmulti)\e[39m\n\e[90m│ \e[39m %2 = \e[33m dynamic \e[39mBase.getindex(c)\e[91m\e[1m::Any\e[22m\e[39m\n\e[90m│ \e[39m %3 = \e[33m dynamic \e[39m(%1)(%2)\e[33m\e[1m::Union{Float32, Int64}\e[22m\e[39m\n\e[90m└──\e[39m return %3\n\n\e[34mSelect a call to descend into or ↩ to ascend.\e[39m\n\n\e[36mToggles\e[39m: [\e[32m\e[1mw\e[22m\e[39m]arn, [\e[31mh\e[39m]ide type-stable statements, [\e[31mo\e[39m]ptimize, [\e[90md\e[39m]ebuginfo, [\e[31mr\e[39m]emarks, [\e[31me\e[39m]ffects, e[\e[31mx\e[39m]ception_types, [\e[31mi\e[39m]nlining costs, [\e[32m\e[1mt\e[22m\e[39m]ype_annotations, [\e[31ms\e[39m]yntax highlight for Source/LLVM/Native, [\e[31mj\e[39m]ump to source always.\n\e[36mShow\e[39m: [\e[31mS\e[39m]ource, [\e[31mA\e[39m]ST, [\e[32m\e[1mT\e[22m\e[39m]yped, [\e[31mL\e[39m]LVM, [\e[31mN\e[39m]ative.\n\e[36mActions\e[39m: [\e[36mq\e[39m]uit, \e[36m⟵\e[39m ascend, [\e[36mb\e[39m]ookmark, [\e[36mE\e[39m]dit source code, [\e[36mR\e[39m]evise and redisplay, dum[\e[36mP\e[39m] params cache.\n\n\e[2K • %2 = runtime < getindex(::Any)::Any >\r\n\e[2K %3 = call → fmulti(::Any)::Union{Float32, Int64}\r\n\e[2K ↩") Stacktrace: [1] top-level scope @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:56 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Cthulhu/7jFQA/test/test_terminal.jl:217 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] ┌ Info: Inference didn't analyze this call because it is a dynamic call: └ Cthulhu nevertheless is trying to descend into it for further inspection. [ Info: tracking LinearAlgebra [ Info: skipped test_irshow.jl Test Summary: | Pass Fail Error Broken Total Time Cthulhu.jl | 1280 2 3 4 1289 10m00.4s Core functionality | 230 1 231 3m47.0s Code view | 85 85 14.7s Provider functionality | 229 229 1m13.3s Terminal tests | 91 1 92 33.2s Terminal | 91 1 92 32.2s Source discarded because of LimitedAccuracy (#642) | 2 2 1.7s Code instances from [semi-]concrete evaluation (#609, #610) | 2 2 3.9s Bookmarks | 9 9 4.2s AbstractInterpreter | 1 1 0.5s Tests with Compiler extension loaded | 644 1 3 3 651 4m11.6s Core functionality | 230 1 231 40.9s Code view | 91 91 1m04.7s Provider functionality | 226 3 229 1m19.7s Example providers | 226 3 229 1m19.4s Provider API | 223 223 8.0s `descend` | 3 3 6 1m11.4s Terminal tests | 96 1 2 99 1m05.8s Terminal | 96 1 2 99 1m04.4s Source discarded because of LimitedAccuracy (#642) | 2 2 3.9s Code instances from [semi-]concrete evaluation (#609, #610) | 2 2 10.6s Bookmarks | 9 9 4.1s AbstractInterpreter | 1 1 0.4s RNG of the outermost testset: Random.Xoshiro(0xe9d08c3f633cbec8, 0xef9ca23f8da8c484, 0xe51b38a07ea1886f, 0xc4a23018a3c17bb2, 0x929ddeccffa9185d) ERROR: LoadError: Some tests did not pass: 1280 passed, 2 failed, 3 errored, 4 broken. in expression starting at /home/pkgeval/.julia/packages/Cthulhu/7jFQA/test/runtests.jl:10 Testing failed after 629.71s ERROR: LoadError: Package Cthulhu errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2535 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2384 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:538 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 677.13s: package tests unexpectedly errored