Package evaluation to test Maracas on Julia 1.14.0-DEV.2058 (afc71c255e*) started at 2026-04-19T11:50:23.288 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 16.39s ################################################################################ # Installation # Installing Maracas... Resolving package versions... Installed Maracas ─ v1.1.0 Updating `~/.julia/environments/v1.14/Project.toml` [329a7628] + Maracas v1.1.0 Updating `~/.julia/environments/v1.14/Manifest.toml` [329a7628] + Maracas v1.1.0 [2a0f44e3] + Base64 v1.11.0 [8ba89e20] + Distributed v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.0.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.13.0 [8dfed614] + Test v1.11.0 Installation completed after 1.27s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling project... 4.8 s ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling project... 3.2 s ✓ Maracas 1 dependency successfully precompiled in 3 seconds. 9 already precompiled. Precompilation completed after 29.5s ################################################################################ # Testing # Testing Maracas Status `/tmp/jl_CkwpPZ/Project.toml` [329a7628] Maracas v1.1.0 [8ba89e20] Distributed v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_CkwpPZ/Manifest.toml` [329a7628] Maracas v1.1.0 [2a0f44e3] Base64 v1.11.0 [8ba89e20] Distributed v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.0.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.13.0 [8dfed614] Test v1.11.0 Testing Running tests... 'describe' returns a TestSet: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 Test threw exception Expression: #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 =# @describe("description", begin #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 =# end) isa AbstractTestSet UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:781 [inlined] [8] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:5 [inlined] [9] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] 'describe' TestSet contains description: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:8 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:9 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:10 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'describe' TestSet description is colored within 'title' env var: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:14 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:15 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:15 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'describe' TestSet description color can be changed: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:19 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:20 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:22 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'it' returns a TestSet: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 Test threw exception Expression: #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 =# @it("description", begin #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 =# end) isa AbstractTestSet UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:781 [inlined] [8] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:28 [inlined] [9] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] 'it' TestSet contains description: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:31 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:32 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:33 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'it' TestSet contains [Spec]: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:37 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:38 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:38 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'it' TestSet description is colored within 'spec' env var: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:42 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:43 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:43 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'test' returns a TestSet: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 Test threw exception Expression: #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 =# @unit("description", begin #= /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 =# end) isa AbstractTestSet UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:781 [inlined] [8] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:48 [inlined] [9] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] 'test' TestSet contains description: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:51 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:52 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:53 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'test' TestSet contains [Test]: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:57 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:58 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:58 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 'test' TestSet description is colored within 'test' env var: Error During Test at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:62 Got exception outside of a @test UndefVarError: `push_testset` not defined in `Test` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] getproperty(x::Module, f::Symbol) @ Base ./Base_compiler.jl:51 [2] top-level scope @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:4 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [4] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:63 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [6] macro expansion @ ~/.julia/packages/Maracas/qRRUl/test/runtests.jl:63 [inlined] [7] macro expansion @ ~/.julia/packages/Maracas/qRRUl/src/Maracas.jl:58 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:327 [9] top-level scope @ none:6 [10] eval(m::Module, e::Any) @ Core ./boot.jl:517 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:318 [12] _start() @ Base ./client.jl:593 Test Summary: | Pass Error Total Time Maracas | 5 12 17 5.2s 'describe' returns a TestSet | 1 1 4.6s 'describe' TestSet contains description | 1 1 0.3s 'describe' TestSet description is colored within 'title' env var | 1 1 0.0s 'describe' TestSet description color can be changed | 1 1 0.0s 'it' returns a TestSet | 1 1 0.1s 'it' TestSet contains description | 1 1 0.0s 'it' TestSet contains [Spec] | 1 1 0.0s 'it' TestSet description is colored within 'spec' env var | 1 1 0.0s 'test' returns a TestSet | 1 1 0.1s 'test' TestSet contains description | 1 1 0.0s 'test' TestSet contains [Test] | 1 1 0.0s 'test' TestSet description is colored within 'test' env var | 1 1 0.0s padding results and descriptions | 5 5 0.1s RNG of the outermost testset: Random.Xoshiro(0x3b14c2024203570a, 0x7431fe97b979f36e, 0x78602267bd09e42b, 0x1a99b4414d374cc0, 0xabbf57993c25bf6b) ERROR: LoadError: Some tests did not pass: 5 passed, 0 failed, 12 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/Maracas/qRRUl/test/runtests.jl:3 Testing failed after 18.53s ERROR: LoadError: Package Maracas errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3162 [3] Cmd(cmd::Cmd) @ Base /opt/julia/share/julia/stdlib/v1.14/Pkg/src/Operations.jl:3025 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:586 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:172 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [7] test @ /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:160 [inlined] [8] test(pkg::String; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.14/Pkg/src/API.jl:159 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:326 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:352 [12] _start() @ Base ./client.jl:593 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 82.2s: package tests unexpectedly errored