Package evaluation to test ScoredTests on Julia 1.14.0-DEV.14 (ec5cf08762*) started at 2025-10-30T11:17:57.533 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.41s ################################################################################ # Installation # Installing ScoredTests... Resolving package versions... Updating `~/.julia/environments/v1.14/Project.toml` [f38cd097] + ScoredTests v0.1.2 Updating `~/.julia/environments/v1.14/Manifest.toml` [f38cd097] + ScoredTests v0.1.2 [de0858da] + Printf v1.11.0 [4ec0a83e] + Unicode v1.11.0 Installation completed after 0.98s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... ┌ Error: Failed to use TestEnv.jl; test dependencies will not be precompiled │ exception = │ UndefVarError: `project_rel_path` not defined in `TestEnv` │ Suggestion: this global was defined as `Pkg.Operations.project_rel_path` but not assigned a value. │ Stacktrace: │ [1] get_test_dir(ctx::Pkg.Types.Context, pkgspec::PackageSpec) │ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/common.jl:75 │ [2] test_dir_has_project_file │ @ ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/common.jl:52 [inlined] │ [3] maybe_gen_project_override! │ @ ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/common.jl:83 [inlined] │ [4] activate(pkg::String; allow_reresolve::Bool) │ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:12 │ [5] activate(pkg::String) │ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:9 │ [6] top-level scope │ @ /PkgEval.jl/scripts/precompile.jl:24 │ [7] include(mod::Module, _path::String) │ @ Base ./Base.jl:309 │ [8] exec_options(opts::Base.JLOptions) │ @ Base ./client.jl:344 │ [9] _start() │ @ Base ./client.jl:577 └ @ Main /PkgEval.jl/scripts/precompile.jl:26 Precompiling package dependencies... Precompiling packages... 1039.7 ms ✓ ScoredTests 1 dependency successfully precompiled in 1 seconds. 2 already precompiled. Precompilation completed after 13.93s ################################################################################ # Testing # Testing ScoredTests Status `/tmp/jl_5MTAsi/Project.toml` [f38cd097] ScoredTests v0.1.2 [de0858da] Printf v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_5MTAsi/Manifest.toml` [f38cd097] ScoredTests v0.1.2 [2a0f44e3] Base64 v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.11.0 [8dfed614] Test v1.11.0 [4ec0a83e] Unicode v1.11.0 Testing Running tests... Return cases: Test Failed at /home/pkgeval/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:21 Expression: #= /home/pkgeval/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:21 =# @scoredtest(1 + 1 == x) == reserrored Evaluated: ScoredTests.ScoredTest{ScoredTests.Result{UndefVarError}, String, Int64}(ScoredTests.Result{UndefVarError}(false, UndefVarError(:x, 0x0000000000009887, Main)), 1, -1, "") == ScoredTests.ScoredTest{ScoredTests.Result{UndefVarError}, String, Int64}(ScoredTests.Result{UndefVarError}(false, UndefVarError(:x, 0x0000000000009887, #undef)), 1, -1, "") Stacktrace: [1] top-level scope @ ~/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:1961 [inlined] [3] macro expansion @ ~/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:9 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:1961 [inlined] [5] macro expansion @ ~/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:14 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:1961 [inlined] [7] macro expansion @ ~/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:21 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:753 [inlined] Test Summary: | Pass Fail Total Time ScoredTests.jl | 22 1 23 5.5s @scoredtest | 7 1 8 5.0s Exceptions | 1 1 0.1s Return cases | 2 1 3 4.9s Basic interpolation | 2 2 0.0s Arguments | 2 2 0.0s ScoredTestSet | 15 15 0.5s RNG of the outermost testset: Random.Xoshiro(0x44bdac686a3ddd94, 0xcdb50cadec9b6eea, 0x15fa5a0d92742c95, 0xc15062e734f449e1, 0x64f349087f030e62) ERROR: LoadError: Some tests did not pass: 22 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ScoredTests/RSCUe/test/runtests.jl:6 Testing failed after 16.0s ERROR: LoadError: Package ScoredTests errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:2936 [3] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:2785 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:572 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:548 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:161 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [9] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [12] include(mod::Module, _path::String) @ Base ./Base.jl:309 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:344 [14] _start() @ Base ./client.jl:577 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 54.51s: package has test failures