Package evaluation to test PerformanceTestTools on Julia 1.14.0-DEV.1475 (42ad41c179*) started at 2026-01-04T12:26:53.921 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 10.23s ################################################################################ # Installation # Installing PerformanceTestTools... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [dc46b164] + PerformanceTestTools v0.1.3 Updating `~/.julia/environments/v1.14/Manifest.toml` [dc46b164] + PerformanceTestTools v0.1.3 [2a0f44e3] + Base64 v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [f489334b] + StyledStrings v1.13.0 [8dfed614] + Test v1.11.0 Installation completed after 0.84s ################################################################################ # Precompilation # ERROR: LoadError: MethodError: no method matching setindex!(::Base.ScopedValues.ScopedValue{IO}, ::Nothing) The function `setindex!` exists, but no method is defined for this combination of argument types. Stacktrace: [1] top-level scope @ /PkgEval.jl/scripts/precompile.jl:10 [2] include(mod::Module, _path::String) @ Base ./Base.jl:309 [3] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [4] _start() @ Base ./client.jl:585 in expression starting at /PkgEval.jl/scripts/precompile.jl:6 caused by: MethodError: no method matching setindex!(::Base.ScopedValues.ScopedValue{IO}, ::Base.DevNull) The function `setindex!` exists, but no method is defined for this combination of argument types. Stacktrace: [1] top-level scope @ /PkgEval.jl/scripts/precompile.jl:7 [2] include(mod::Module, _path::String) @ Base ./Base.jl:309 [3] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [4] _start() @ Base ./client.jl:585 Precompilation failed after 12.99s ################################################################################ # Testing # Testing PerformanceTestTools Status `/tmp/jl_u8EbEj/Project.toml` [dc46b164] PerformanceTestTools v0.1.3 [b77e0a4c] InteractiveUtils v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_u8EbEj/Manifest.toml` [dc46b164] PerformanceTestTools v0.1.3 [2a0f44e3] Base64 v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.13.0 [8dfed614] Test v1.11.0 Testing Running tests... test set: Test Failed at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:25 Expression: nmatches(r"fadd fast <[0-9]+ x double>", llvm_ir(vdot, (v, v))) >= 4 Evaluated: 0 >= 4 Stacktrace: [1] top-level scope @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:24 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:1995 [inlined] [3] macro expansion @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:25 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:773 [inlined] ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="1" B="1" $julia [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="2" B="2" $julia --compile=min [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE [ Info: Waiting for parallel tasks... ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="1" B="1" $julia [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="2" B="2" $julia --compile=min [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Test result: All success │ Script : /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl │ Command: A="1" B="1" $julia └ ┌ Test result: All success │ Script : /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl │ Command: A="2" B="2" $julia --compile=min └ Test Summary: | Pass Fail Total Time expected pass | 2 1 3 14.5s test set | 1 1 5.2s RNG of the outermost testset: Random.Xoshiro(0xbefe56ba71aabe6f, 0x8deedfcf276a7e39, 0x4eee5bd9a1a1b284, 0xf6a138b7fcc955a4, 0xb1db4e6ff9940d2a) ERROR: LoadError: Some tests did not pass: 2 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/runtests.jl:5 Testing failed after 24.32s ERROR: LoadError: Package PerformanceTestTools errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3067 [3] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:2916 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:572 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:548 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:161 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [9] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:237 [12] include(mod::Module, _path::String) @ Base ./Base.jl:309 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [14] _start() @ Base ./client.jl:585 in expression starting at /PkgEval.jl/scripts/evaluate.jl:228 PkgEval failed after 69.98s: package has test failures