Package evaluation to test BenchPerfConfigSweeps on Julia 1.14.0-DEV.2373 (cf67ecc88f*) started at 2026-06-13T12:09:48.175 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 15.83s ################################################################################ # Installation # Installing BenchPerfConfigSweeps... Resolving package versions... Installed CompositionsBase ──────────── v0.1.2 Installed Formatting ────────────────── v0.4.3 Installed ConstructionBase ──────────── v1.6.0 Installed IteratorInterfaceExtensions ─ v1.0.0 Installed DelimitedFiles ────────────── v1.9.1 Installed OrderedCollections ────────── v1.8.2 Installed Compat ────────────────────── v3.47.0 Installed DataAPI ───────────────────── v1.16.0 Installed DataValueInterfaces ───────── v1.0.0 Installed MacroTools ────────────────── v0.5.16 Installed Statistics ────────────────── v1.11.1 Installed JSON3 ─────────────────────── v1.14.3 Installed ArgCheck ──────────────────── v2.5.0 Installed PrecompileTools ───────────── v1.3.4 Installed AutoHashEquals ────────────── v0.2.0 Installed JSON ──────────────────────── v0.21.4 Installed Parsers ───────────────────── v2.8.5 Installed Tables ────────────────────── v1.12.1 Installed Reexport ──────────────────── v1.2.2 Installed InverseFunctions ──────────── v0.1.17 Installed BenchmarkConfigSweeps ─────── v0.1.0 Installed TableTraits ───────────────── v1.0.1 Installed BenchmarkTools ────────────── v1.5.0 Installed Crayons ───────────────────── v4.1.1 Installed StructTypes ───────────────── v1.11.0 Installed Preferences ───────────────── v1.5.2 Installed PrettyTables ──────────────── v1.3.1 Installed BenchPerfConfigSweeps ─────── v0.1.0 Installed BenchPerf ─────────────────── v0.1.0 Installed Accessors ─────────────────── v0.1.44 Updating `~/.julia/environments/v1.14/Project.toml` [ff6ab34e] + BenchPerfConfigSweeps v0.1.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [7d9f7c33] + Accessors v0.1.44 [dce04be8] + ArgCheck v2.5.0 ⌅ [15f4f7f2] + AutoHashEquals v0.2.0 [368ecf39] + BenchPerf v0.1.0 [ff6ab34e] + BenchPerfConfigSweeps v0.1.0 [5dead3b6] + BenchmarkConfigSweeps v0.1.0 ⌃ [6e4b80f9] + BenchmarkTools v1.5.0 ⌅ [34da2185] + Compat v3.47.0 [a33af91c] + CompositionsBase v0.1.2 [187b0558] + ConstructionBase v1.6.0 [a8cc5b0e] + Crayons v4.1.1 [9a962f9c] + DataAPI v1.16.0 [e2d170a0] + DataValueInterfaces v1.0.0 [8bb1440f] + DelimitedFiles v1.9.1 [59287772] + Formatting v0.4.3 [3587e190] + InverseFunctions v0.1.17 [82899510] + IteratorInterfaceExtensions v1.0.0 ⌅ [682c06a0] + JSON v0.21.4 [0f8b85d8] + JSON3 v1.14.3 [1914dd2f] + MacroTools v0.5.16 ⌅ [bac558e1] + OrderedCollections v1.8.2 [69de0a69] + Parsers v2.8.5 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 ⌅ [08abe8d2] + PrettyTables v1.3.1 [189a3867] + Reexport v1.2.2 [10745b16] + Statistics v1.11.1 [856f2bd8] + StructTypes v1.11.0 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.12.1 [0dad84c5] + ArgTools v1.2.0 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [b27032c2] + LibCURL v1.0.0 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.14.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.14.0 [de0858da] + Printf v1.11.0 [9abbd945] + Profile v1.11.0 [3fa0cd96] + REPL v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.2+0 [deac9b47] + LibCURL_jll v8.20.0+1 [e37daf67] + LibGit2_jll v1.9.4+0 [29816b5a] + LibSSH2_jll v1.11.101+0 [14a3606d] + MozillaCACerts_jll v2026.5.14 [4536629a] + OpenBLAS_jll v0.3.33+0 [458c3c95] + OpenSSL_jll v3.5.7+0 [efcefdf7] + PCRE2_jll v10.47.0+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [83775a58] + Zlib_jll v1.3.2+0 [3161d3a3] + Zstd_jll v1.5.7+1 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] + nghttp2_jll v1.69.0+0 [3f19e933] + p7zip_jll v17.8.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m` Installation completed after 5.58s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling project... 6.1 s ✓ TestEnv 1 dependency successfully precompiled in 6 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling project... 3.8 s ✓ MacroTools 0.5 s ✓ Reexport 1.0 s ✓ Statistics 1.0 s ✓ DataAPI 1.3 s ✓ ConstructionBase 0.5 s ✓ DataValueInterfaces 129.6 s ✓ OrderedCollections 0.9 s ✓ InverseFunctions 0.7 s ✓ CompositionsBase 0.9 s ✓ ArgCheck 0.8 s ✓ Terminators 0.7 s ✓ AutoHashEquals 0.5 s ✓ IteratorInterfaceExtensions 2.0 s ✓ Crayons 1.0 s ✓ DelimitedFiles ┌ Warning: DEPRECATION NOTICE │ │ Formatting.jl has been unmaintained for a while, with some serious │ correctness bugs compromising the original purpose of the package. As a result, │ it has been deprecated - consider using an alternative, such as │ `Format.jl` (https://github.com/JuliaString/Format.jl) or the `Printf` stdlib directly. │ │ If you are not using Formatting.jl as a direct dependency, please consider │ opening an issue on any packages you are using that do use it as a dependency. │ From Julia 1.9 onwards, you can query `]why Formatting` to figure out which │ package originally brings it in as a dependency. └ @ Formatting ~/.julia/packages/Formatting/3VxOt/src/Formatting.jl:12 34.2 s ✓ Formatting 3.2 s ✓ StructTypes 2.5 s ✓ Preferences 5.7 s ✓ LoadAllPackages 36.7 s ✓ Statistics → SparseArraysExt 0.6 s ✓ ConstructionBase → ConstructionBaseLinearAlgebraExt 34.7 s ✓ InverseFunctions → InverseFunctionsTestExt 1.2 s ✓ InverseFunctions → InverseFunctionsDatesExt 0.8 s ✓ CompositionsBase → CompositionsBaseInverseFunctionsExt 0.7 s ✓ TableTraits 2.7 s ✓ PrecompileTools 53.9 s ✓ TestFunctionRunner 118.9 s ✓ Compat 6.1 s ✓ Accessors 129.5 s ✓ Tables 32.4 s ✓ Parsers 74.5 s ✓ Aqua 3.1 s ✓ Accessors → LinearAlgebraExt 34.5 s ✓ Accessors → TestExt 67.4 s ✓ PrettyTables 35.5 s ✓ JSON3 27.3 s ✓ JSON 27.6 s ✓ BenchmarkTools 57.1 s ✓ BenchPerf 62.2 s ✓ BenchmarkConfigSweeps 33.5 s ✓ BenchPerfConfigSweeps 41 dependencies successfully precompiled in 1032 seconds. 38 already precompiled. 1 dependency had output during precompilation: ┌ Formatting │ ┌ Warning: DEPRECATION NOTICE │ │ │ │ Formatting.jl has been unmaintained for a while, with some serious │ │ correctness bugs compromising the original purpose of the package. As a result, │ │ it has been deprecated - consider using an alternative, such as │ │ `Format.jl` (https://github.com/JuliaString/Format.jl) or the `Printf` stdlib directly. │ │ │ │ If you are not using Formatting.jl as a direct dependency, please consider │ │ opening an issue on any packages you are using that do use it as a dependency. │ │ From Julia 1.9 onwards, you can query `]why Formatting` to figure out which │ │ package originally brings it in as a dependency. │ └ @ Formatting ~/.julia/packages/Formatting/3VxOt/src/Formatting.jl:12 └ Precompilation completed after 1066.81s ################################################################################ # Testing # Testing BenchPerfConfigSweeps Status `/tmp/jl_w18JA7/Project.toml` ⌅ [4c88cf16] Aqua v0.5.6 [ff6ab34e] BenchPerfConfigSweeps v0.1.0 [792026f5] TestFunctionRunner v0.1.4 [8dfed614] Test v1.11.0 Status `/tmp/jl_w18JA7/Manifest.toml` [7d9f7c33] Accessors v0.1.44 ⌅ [4c88cf16] Aqua v0.5.6 [dce04be8] ArgCheck v2.5.0 ⌅ [15f4f7f2] AutoHashEquals v0.2.0 [368ecf39] BenchPerf v0.1.0 [ff6ab34e] BenchPerfConfigSweeps v0.1.0 [5dead3b6] BenchmarkConfigSweeps v0.1.0 ⌃ [6e4b80f9] BenchmarkTools v1.5.0 ⌅ [34da2185] Compat v3.47.0 [a33af91c] CompositionsBase v0.1.2 [187b0558] ConstructionBase v1.6.0 [a8cc5b0e] Crayons v4.1.1 [9a962f9c] DataAPI v1.16.0 [e2d170a0] DataValueInterfaces v1.0.0 [8bb1440f] DelimitedFiles v1.9.1 [59287772] Formatting v0.4.3 [3587e190] InverseFunctions v0.1.17 [82899510] IteratorInterfaceExtensions v1.0.0 ⌅ [682c06a0] JSON v0.21.4 [0f8b85d8] JSON3 v1.14.3 [b37bcd2d] LoadAllPackages v0.1.0 [1914dd2f] MacroTools v0.5.16 ⌅ [bac558e1] OrderedCollections v1.8.2 [69de0a69] Parsers v2.8.5 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 ⌅ [08abe8d2] PrettyTables v1.3.1 [189a3867] Reexport v1.2.2 [10745b16] Statistics v1.11.1 [856f2bd8] StructTypes v1.11.0 [3783bdb8] TableTraits v1.0.1 [bd369af6] Tables v1.12.1 [b0858c3f] Terminators v0.1.1 [792026f5] TestFunctionRunner v0.1.4 [0dad84c5] ArgTools v1.2.0 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [b27032c2] LibCURL v1.0.0 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.14.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.2+0 [deac9b47] LibCURL_jll v8.20.0+1 [e37daf67] LibGit2_jll v1.9.4+0 [29816b5a] LibSSH2_jll v1.11.101+0 [14a3606d] MozillaCACerts_jll v2026.5.14 [4536629a] OpenBLAS_jll v0.3.33+0 [458c3c95] OpenSSL_jll v3.5.7+0 [efcefdf7] PCRE2_jll v10.47.0+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [83775a58] Zlib_jll v1.3.2+0 [3161d3a3] Zstd_jll v1.5.7+1 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.69.0+0 [3f19e933] p7zip_jll v17.8.0+0 Info Packages marked with ⌃ and ⌅ have new versions available. Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. Testing Running tests... [ Info: Loading packages from `/home/pkgeval/.julia/packages/BenchPerfConfigSweeps/zKpyT/test/BenchPerfConfigSweepsTests/Project.toml`... [ Info: Loading 3 packages... [ Info: 3 packages loaded in 0.089131955 seconds 1 ambiguities found Ambiguity #1 adopt_scope(exs::Base.JuliaSyntax.SyntaxList, ref) @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/ast.jl:396 adopt_scope(ex, ctx::Base.JuliaLowering.MacroContext) @ Base.JuliaLowering /source/usr/share/julia/JuliaLowering/src/macro_expansion.jl:91 Possible fix, define adopt_scope(::Base.JuliaSyntax.SyntaxList, ::Base.JuliaLowering.MacroContext) Method ambiguity: Test Failed at /home/pkgeval/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:117 Expression: success(pipeline(cmd; stdout = stdout, stderr = stderr)) Evaluated: success(pipeline(pipeline(`/opt/julia/bin/julia -C native -J/opt/julia/lib/julia/sys.so --depwarn=yes --check-bounds=yes --pkgimages=existing -g1 --startup-file=no --startup-file=no -e 'append!(empty!(Base.DEPOT_PATH), ["/home/pkgeval/.julia", "/usr/local/share/julia", "/opt/julia/local/share/julia", "/opt/julia/share/julia"]) append!(empty!(Base.DL_LOAD_PATH), String[]) append!(empty!(Base.LOAD_PATH), ["/tmp/jl_w18JA7/Project.toml", "/home/pkgeval/.julia/packages/BenchPerfConfigSweeps/zKpyT/test/BenchPerfConfigSweepsTests/Project.toml"]) ENV["JULIA_LOAD_PATH"] = "/tmp/jl_w18JA7/Project.toml:/home/pkgeval/.julia/packages/BenchPerfConfigSweeps/zKpyT/test/BenchPerfConfigSweepsTests/Project.toml" Base.set_active_project(nothing) using Aqua Aqua.test_ambiguities_impl( [ Base.PkgId(Base.UUID(0xff6ab34e6c4e401faa49786a197b91d4), "BenchPerfConfigSweeps") Base.PkgId("Base") Base.PkgId("Core") ] , (recursive = true,), Aqua.ExcludeSpec[], ) || exit(1) '`, stdout>Base.PipeEndpoint(RawFD(12) open, 0 bytes waiting)), stderr>Base.PipeEndpoint(RawFD(14) open, 0 bytes waiting))) Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:564 [inlined] [2] _test_ambiguities(packages::Vector{Base.PkgId}; color::Nothing, exclude::Vector{Any}, detect_ambiguities_options::@Kwargs{}) @ Aqua ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:117 [3] _test_ambiguities(packages::Vector{Base.PkgId}) @ Aqua ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:90 [inlined] [4] macro expansion @ ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:27 [inlined] [5] test_ambiguities(packages::Vector{Module}; kwargs::@Kwargs{}) @ Aqua ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:1 [inlined] [6] macro expansion @ ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:27 [inlined] [7] test_ambiguities(packages::Vector{Module}) @ Aqua ~/.julia/packages/Aqua/bqhPD/src/ambiguities.jl:1 [inlined] [8] macro expansion @ ~/.julia/packages/Aqua/bqhPD/src/Aqua.jl:96 [inlined] [9] test_all(testtarget::Module; ambiguities::Bool, unbound_args::Bool, undefined_exports::Bool, project_extras::Bool, stale_deps::Bool, deps_compat::Bool, project_toml_formatting::Bool) @ Aqua ~/.julia/packages/Aqua/bqhPD/src/Aqua.jl:39 ┌ Warning: `isbindingresolved(m::Module, var::Symbol)` is deprecated, use `true` instead. │ caller = walkmodules(f::Aqua.var"#detect_unbound_args_recursively##->###0"{Vector{Any}}, x::Module) at exports.jl:5 └ @ Aqua ~/.julia/packages/Aqua/bqhPD/src/exports.jl:5 ┌ Warning: `isbindingresolved(m::Module, var::Symbol)` is deprecated, use `true` instead. │ caller = walkmodules(f::Aqua.var"#undefined_exports##->###0"{Vector{Symbol}}, x::Module) at exports.jl:5 └ @ Aqua ~/.julia/packages/Aqua/bqhPD/src/exports.jl:5 Test Summary: | Pass Fail Total Time BenchPerfConfigSweepsTests | 7 1 8 5m49.1s TestAqua | 7 1 8 5m47.5s test | 7 1 8 5m46.4s Method ambiguity | 1 1 3m40.1s Unbound type parameters | 1 1 2.5s Undefined exports | 1 1 0.1s Compare Project.toml and test/Project.toml | 1 1 0.4s Stale dependencies | 1 1 1m47.8s Compat bounds | 1 1 1.7s Project.toml formatting | 2 2 0.7s RNG of the outermost testset: Random.Xoshiro(0x3f301acacc757171, 0xa7ab17d0a48992cb, 0x7fbd27523dcd82a7, 0xf8d87ec2018b216b, 0x82ce9e25f9e3a102) ERROR: LoadError: Some tests did not pass: 7 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/BenchPerfConfigSweeps/zKpyT/test/runtests.jl:2 Testing failed after 554.15s ERROR: LoadError: Package BenchPerfConfigSweeps errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3247 [3] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:587 [4] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [5] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [6] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [7] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [8] include(mod::Module, _path::String) @ Base Base.jl:325 [9] exec_options(opts::Base.JLOptions) @ Base client.jl:355 [10] _start() @ Base client.jl:596 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 1663.67s: package has test failures