Package evaluation to test PerfChecker on Julia 1.12.7-DEV.42 (6f510b6086*) started at 2026-06-19T17:39:43.789 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.47s ################################################################################ # Installation # Installing PerfChecker... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [6309bf6b] + PerfChecker v0.2.4 Updating `~/.julia/environments/v1.12/Manifest.toml` [79e6a3ab] + Adapt v4.6.1 [336ed68f] + CSV v0.10.16 [944b1d66] + CodecZlib v0.7.8 [34da2185] + Compat v4.18.1 [c36e975a] + CoverageTools v1.4.1 [adafc99b] + CpuId v0.3.1 [9a962f9c] + DataAPI v1.16.0 [e2d170a0] + DataValueInterfaces v1.0.0 [85a47980] + Dictionaries v0.4.6 [48062228] + FilePathsBase v0.9.24 [313cdc1a] + Indexing v1.1.1 [842dd82b] + InlineStrings v1.4.5 [82899510] + IteratorInterfaceExtensions v1.0.0 ⌅ [682c06a0] + JSON v0.21.4 [70703baa] + JuliaSyntax v1.0.2 [36869731] + Malt v1.4.1 ⌅ [bac558e1] + OrderedCollections v1.8.2 [69de0a69] + Parsers v2.8.6 [6309bf6b] + PerfChecker v0.2.4 [2dfb63ee] + PooledArrays v1.4.3 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [05181044] + RelocatableFolders v1.0.1 [6c6a2e73] + Scratch v1.3.0 [91c51154] + SentinelArrays v1.4.10 [03a91e81] + SplitApplyCombine v1.3.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [3bb67fe8] + TranscodingStreams v0.11.3 [9d95f2ec] + TypedTables v1.4.6 [ea10d353] + WeakRefStrings v1.4.3 [76eceee3] + WorkerUtilities v1.6.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [9fa8497b] + Future v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.1 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.6+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 6.6s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 8444.4 ms ✓ PerfChecker 26323.8 ms ✓ PerfChecker → BenchmarkToolsExt 8817.9 ms ✓ PerfChecker → ChairmarksExt 3 dependencies successfully precompiled in 44 seconds. 86 already precompiled. 24 dependencies precompiled but different versions are currently loaded (ArgTools, Base64, Dates, Downloads, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Markdown, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, Pkg, Printf, StyledStrings, TOML, Tar, UUIDs, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 37 dependents of these packages may trigger further precompilation to work with the unexpected versions. 2 dependencies had output during precompilation: ┌ PerfChecker → BenchmarkToolsExt │ [ Info: PERFCHECKER_UUID not set in the environment. Looking for it ... │ ┌ Warning: ... not found. Generating a new one and writing it to /home/pkgeval/.julia/perfchecker/uuid. │ │ Please set it in the environment, `ENV["PerfChecker_UUID"] = "your_UUID"`, if you want to use a specific one. │ │ `PerfChecker.get_uuid()`: 166acf23-6863-4662-af23-0434bbad8195 │ └ @ PerfChecker ~/.julia/packages/PerfChecker/ISivM/src/init.jl:17 └ ┌ PerfChecker → ChairmarksExt │ [ Info: PERFCHECKER_UUID not set in the environment. Looking for it ... │ [ Info: ... found it in /home/pkgeval/.julia/perfchecker/uuid. └ Precompilation completed after 62.83s ################################################################################ # Testing # Testing PerfChecker Status `/tmp/jl_KhOOUf/Project.toml` [4c88cf16] Aqua v0.8.16 [6e4b80f9] BenchmarkTools v1.8.0 [336ed68f] CSV v0.10.16 [0ca39b1e] Chairmarks v1.3.1 [c36e975a] CoverageTools v1.4.1 [adafc99b] CpuId v0.3.1 [d8418881] Intervals v1.11.0 ⌅ [682c06a0] JSON v0.21.4 [36869731] Malt v1.4.1 [c18a7f1d] PatternFolds v0.2.6 [6309bf6b] PerfChecker v0.2.4 [9d95f2ec] TypedTables v1.4.6 [44cfe95a] Pkg v1.12.1 [9abbd945] Profile v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 Status `/tmp/jl_KhOOUf/Manifest.toml` [79e6a3ab] Adapt v4.6.1 [4c88cf16] Aqua v0.8.16 [31f734f8] ArrowTypes v2.3.0 [6e4b80f9] BenchmarkTools v1.8.0 [336ed68f] CSV v0.10.16 [0ca39b1e] Chairmarks v1.3.1 [944b1d66] CodecZlib v0.7.8 [34da2185] Compat v4.18.1 [c36e975a] CoverageTools v1.4.1 [adafc99b] CpuId v0.3.1 [9a962f9c] DataAPI v1.16.0 [e2d170a0] DataValueInterfaces v1.0.0 [85a47980] Dictionaries v0.4.6 [e2ba6199] ExprTools v0.1.10 [48062228] FilePathsBase v0.9.24 [313cdc1a] Indexing v1.1.1 [842dd82b] InlineStrings v1.4.5 [d8418881] Intervals v1.11.0 [82899510] IteratorInterfaceExtensions v1.0.0 ⌅ [682c06a0] JSON v0.21.4 [70703baa] JuliaSyntax v1.0.2 [50d2b5c4] Lazy v0.15.1 [1914dd2f] MacroTools v0.5.16 [36869731] Malt v1.4.1 [78c3b35d] Mocking v0.8.1 ⌅ [bac558e1] OrderedCollections v1.8.2 [69de0a69] Parsers v2.8.6 [c18a7f1d] PatternFolds v0.2.6 [6309bf6b] PerfChecker v0.2.4 [2dfb63ee] PooledArrays v1.4.3 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [3cdcf5f2] RecipesBase v1.3.4 [05181044] RelocatableFolders v1.0.1 [6c6a2e73] Scratch v1.3.0 [91c51154] SentinelArrays v1.4.10 [03a91e81] SplitApplyCombine v1.3.0 [10745b16] Statistics v1.11.1 [dc5dba14] TZJData v1.5.0+2025b [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [1c621080] TestItems v1.0.0 [f269a46b] TimeZones v1.22.2 [3bb67fe8] TranscodingStreams v0.11.3 [9d95f2ec] TypedTables v1.4.6 [ea10d353] WeakRefStrings v1.4.3 [76eceee3] WorkerUtilities v1.6.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [9fa8497b] Future v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.6+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 1590.9 ms ✓ CoverageTools 8469.4 ms ✓ PerfChecker 2 dependencies successfully precompiled in 11 seconds. 64 already precompiled. 25 dependencies precompiled but different versions are currently loaded (ArgTools, Base64, Dates, Downloads, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Markdown, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, Pkg, Printf, Serialization, StyledStrings, TOML, Tar, UUIDs, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 24 dependents of these packages may trigger further precompilation to work with the unexpected versions. [ Info: PERFCHECKER_UUID not set in the environment. Looking for it ... [ Info: ... found it in /home/pkgeval/.julia/perfchecker/uuid. Precompiling packages... 16228.7 ms ✓ BenchmarkTools 1 dependency successfully precompiled in 16 seconds. 16 already precompiled. 13 dependencies precompiled but different versions are currently loaded (Dates, JSON, Logging, Mmap, Parsers, PrecompileTools, Preferences, Printf, Profile, StyledStrings, TOML, UUIDs and Unicode). Restart julia to access the new versions. Otherwise, 3 dependents of these packages may trigger further precompilation to work with the unexpected versions. Precompiling packages... 7807.3 ms ✓ PerfChecker → BenchmarkToolsExt 1 dependency successfully precompiled in 9 seconds. 68 already precompiled. 67 dependencies precompiled but different versions are currently loaded (Adapt, ArgTools, Base64, BenchmarkTools, CSV, CodecZlib, Compat, Compat → CompatLinearAlgebraExt, CoverageTools, CpuId, DataAPI, DataValueInterfaces, Dates, Dictionaries, Distributed, Downloads, FilePathsBase, FilePathsBase → FilePathsBaseMmapExt, Future, Indexing, InlineStrings, InlineStrings → ParsersExt, IteratorInterfaceExtensions, JSON, JuliaSyntax, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Malt, Markdown, Mmap, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, OrderedCollections, Parsers, PerfChecker, Pkg, PooledArrays, PrecompileTools, Preferences, Printf, Profile, RelocatableFolders, Scratch, SentinelArrays, Serialization, SplitApplyCombine, Statistics, StyledStrings, TOML, TableTraits, Tables, Tar, TranscodingStreams, TypedTables, UUIDs, Unicode, WeakRefStrings, WorkerUtilities, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 1 dependent of these packages may trigger further precompilation to work with the unexpected versions. Precompiling packages... 7713.7 ms ✓ PerfChecker → ChairmarksExt 1 dependency successfully precompiled in 8 seconds. 67 already precompiled. 66 dependencies precompiled but different versions are currently loaded (Adapt, ArgTools, Base64, CSV, Chairmarks, CodecZlib, Compat, Compat → CompatLinearAlgebraExt, CoverageTools, CpuId, DataAPI, DataValueInterfaces, Dates, Dictionaries, Distributed, Downloads, FilePathsBase, FilePathsBase → FilePathsBaseMmapExt, Future, Indexing, InlineStrings, InlineStrings → ParsersExt, IteratorInterfaceExtensions, JSON, JuliaSyntax, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Malt, Markdown, Mmap, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, OrderedCollections, Parsers, PerfChecker, Pkg, PooledArrays, PrecompileTools, Preferences, Printf, Profile, RelocatableFolders, Scratch, SentinelArrays, Serialization, SplitApplyCombine, StyledStrings, TOML, TableTraits, Tables, Tar, TranscodingStreams, TypedTables, UUIDs, Unicode, WeakRefStrings, WorkerUtilities, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 1 dependent of these packages may trigger further precompilation to work with the unexpected versions. Precompiling packages... 880.2 ms ✓ Chairmarks → StatisticsChairmarksExt 1 dependency successfully precompiled in 2 seconds. 4 already precompiled. 4 dependencies precompiled but different versions are currently loaded (Chairmarks, Printf, Statistics and Unicode). Restart julia to access the new versions. Otherwise, 1 dependent of these packages may trigger further precompilation to work with the unexpected versions. PatternFolds.jl: Error During Test at /home/pkgeval/.julia/packages/PerfChecker/ISivM/test/pattern_folds.jl:1 Got exception outside of a @test MethodError: no method matching getindex(::Nothing, ::String) The function `getindex` exists, but no method is defined for this combination of argument types. Stacktrace: [1] get_pkg_versions(name::String, regname::Nothing) @ PerfChecker ~/.julia/packages/PerfChecker/ISivM/src/versions.jl:26 [2] get_versions(pkgconf::Tuple{String, Symbol, Vector{VersionNumber}, Bool}, regname::Nothing) @ PerfChecker ~/.julia/packages/PerfChecker/ISivM/src/versions.jl:89 [3] get_versions @ ~/.julia/packages/PerfChecker/ISivM/src/versions.jl:89 [inlined] [4] check_function(x::Symbol, d::Dict{Symbol, Any}, block1::Expr, block2::Expr) @ PerfChecker ~/.julia/packages/PerfChecker/ISivM/src/check.jl:43 [5] top-level scope @ ~/.julia/packages/PerfChecker/ISivM/test/pattern_folds.jl:2 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [7] macro expansion @ ~/.julia/packages/PerfChecker/ISivM/test/pattern_folds.jl:6 [inlined] [8] macro expansion @ ~/.julia/packages/PerfChecker/ISivM/src/check.jl:164 [inlined] [9] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [10] top-level scope @ ~/.julia/packages/PerfChecker/ISivM/test/runtests.jl:4 [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [12] macro expansion @ ~/.julia/packages/PerfChecker/ISivM/test/runtests.jl:7 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [14] macro expansion @ ~/.julia/packages/PerfChecker/ISivM/test/runtests.jl:11 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [19] _start() @ Base ./client.jl:550 Test Summary: | Pass Error Total Time Package tests: PerfChecker | 12 1 13 5m06.9s Aqua.jl | 12 12 4m07.2s Other Packages | 1 1 59.7s PatternFolds.jl | 1 1 23.5s RNG of the outermost testset: Random.Xoshiro(0x8e38dc8eb936b722, 0x69dc0320bb4dd86a, 0x578bebc8b1eeac67, 0x4e673e9181440630, 0xa65b36d6eda5c9b3) ERROR: LoadError: Some tests did not pass: 12 passed, 0 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/PerfChecker/ISivM/test/runtests.jl:3 Testing failed after 319.65s ERROR: LoadError: Package PerfChecker errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2538 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2387 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:552 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 418.32s: package tests unexpectedly errored