Package evaluation to test CodeEvaluation on Julia 1.10.10 (c8be17dcfd*) started at 2026-02-02T14:14:09.567 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.10` Set-up completed after 5.15s ################################################################################ # Installation # Installing CodeEvaluation... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [5a076611] + CodeEvaluation v0.0.1 Updating `~/.julia/environments/v1.10/Manifest.toml` [5a076611] + CodeEvaluation v0.0.1 ⌅ [b5f81e59] + IOCapture v0.2.5 [2a0f44e3] + Base64 [b77e0a4c] + InteractiveUtils [56ddb016] + Logging [d6f4376e] + Markdown [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [6462fe0b] + Sockets [4ec0a83e] + Unicode Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 4.09s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 1226.2 ms ✓ CodeEvaluation 1 dependency successfully precompiled in 2 seconds. 2 already precompiled. Precompilation completed after 10.13s ################################################################################ # Testing # Testing CodeEvaluation Status `/tmp/jl_eQzety/Project.toml` [5a076611] CodeEvaluation v0.0.1 ⌅ [b5f81e59] IOCapture v0.2.5 [3fa0cd96] REPL [8dfed614] Test Status `/tmp/jl_eQzety/Manifest.toml` [5a076611] CodeEvaluation v0.0.1 ⌅ [b5f81e59] IOCapture v0.2.5 [2a0f44e3] Base64 [b77e0a4c] InteractiveUtils [56ddb016] Logging [d6f4376e] Markdown [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [8dfed614] Test [4ec0a83e] Unicode Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... evaluate! - output capture: Test Failed at /home/pkgeval/.julia/packages/CodeEvaluation/str5I/test/sandbox.jl:125 Expression: r.output === "\e[31m123\e[39m" Evaluated: "123" === "\e[31m123\e[39m" Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:673 [inlined] [2] macro expansion @ ~/.julia/packages/CodeEvaluation/str5I/test/sandbox.jl:125 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1582 [inlined] [4] top-level scope @ ~/.julia/packages/CodeEvaluation/str5I/test/sandbox.jl:103 Test Summary: | Pass Fail Broken Total Time CodeEvaluation.jl | 185 1 2 188 9.6s parseblock() | 35 35 2.2s Sandbox | 66 1 67 5.7s Sandbox | 6 6 0.1s Core.eval | 3 3 0.2s evaluate! - basic | 12 12 0.5s evaluate! - ans | 18 18 0.0s evaluate! - pwd | 7 7 0.3s evaluate! - output capture | 14 1 15 4.1s evaluate! - scoping | 6 6 0.2s codeblock! | 43 2 45 0.5s replblock! | 41 41 1.2s ERROR: LoadError: Some tests did not pass: 185 passed, 1 failed, 0 errored, 2 broken. in expression starting at /home/pkgeval/.julia/packages/CodeEvaluation/str5I/test/runtests.jl:4 Testing failed after 14.7s ERROR: LoadError: Package CodeEvaluation errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 40.24s: package has test failures