Package evaluation of PerformanceTestTools on Julia 1.10.9 (96dc2d8c45*) started at 2025-06-06T11:33:48.681 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 5.27s ################################################################################ # Installation # Installing PerformanceTestTools... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [dc46b164] + PerformanceTestTools v0.1.3 Updating `~/.julia/environments/v1.10/Manifest.toml` [dc46b164] + PerformanceTestTools v0.1.3 [2a0f44e3] + Base64 [b77e0a4c] + InteractiveUtils [56ddb016] + Logging [d6f4376e] + Markdown [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [8dfed614] + Test Installation completed after 3.98s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 8.14s ################################################################################ # Testing # Testing PerformanceTestTools Status `/tmp/jl_yKasLJ/Project.toml` [dc46b164] PerformanceTestTools v0.1.3 [b77e0a4c] InteractiveUtils [8dfed614] Test Status `/tmp/jl_yKasLJ/Manifest.toml` [dc46b164] PerformanceTestTools v0.1.3 [2a0f44e3] Base64 [b77e0a4c] InteractiveUtils [56ddb016] Logging [d6f4376e] Markdown [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [8dfed614] Test Testing Running tests... ┌ Info: Running IR test in a subprocess... │ cmd = `/opt/julia/bin/julia -C native -J/opt/julia/lib/julia/sys.so --depwarn=yes --check-bounds=yes -g1 --startup-file=no --pkgimages=no --startup-file=no --check-bounds=no --code-coverage=none --inline=yes` └ script = "/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl" test set: Test Failed at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:25 Expression: nmatches(r"fadd fast <[0-9]+ x double>", llvm_ir(vdot, (v, v))) >= 4 Evaluated: 0 >= 4 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:25 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:24 Test Summary: | Fail Total Time test set | 1 1 4.6s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_ir.jl:23 expected pass: Test Failed at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/src/PerformanceTestTools.jl:34 Expression: success(pipeline(`$cmd -e $code`; stdout = stdout, stderr = stderr)) Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] run_ir_test_script(script::String, include::typeof(include), dir::String) @ PerformanceTestTools ~/.julia/packages/PerformanceTestTools/cYTSX/src/PerformanceTestTools.jl:34 [3] macro expansion @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/runtests.jl:6 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [5] top-level scope @ ~/.julia/packages/PerformanceTestTools/cYTSX/test/runtests.jl:6 [ Info: Running IR test in a subprocess...DONE ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="1" B="1" $julia [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="2" B="2" $julia --compile=min [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE [ Info: Waiting for parallel tasks... ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="1" B="1" $julia [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess... └ spec = CLISpec: A="2" B="2" $julia --compile=min [ Info: Running `/home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl` in a subprocess...DONE ┌ Test result: All success │ Script : /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl │ Command: A="1" B="1" $julia └ ┌ Test result: All success │ Script : /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/__test_a_eq_b.jl │ Command: A="2" B="2" $julia --compile=min └ Test Summary: | Pass Fail Total Time expected pass | 2 1 3 21.1s ERROR: LoadError: Some tests did not pass: 2 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/PerformanceTestTools/cYTSX/test/runtests.jl:5 Testing failed after 26.04s ERROR: LoadError: Package PerformanceTestTools errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 49.3s: package has test failures