Package evaluation of NarrativeTest on Julia 1.13.0-DEV.1080 (ed57414aec*) started at 2025-09-04T11:16:17.966 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.59s ################################################################################ # Installation # Installing NarrativeTest... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [9563631e] + NarrativeTest v0.7.5 Updating `~/.julia/environments/v1.13/Manifest.toml` [9563631e] + NarrativeTest v0.7.5 [2a0f44e3] + Base64 v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [f489334b] + StyledStrings v1.11.0 [8dfed614] + Test v1.11.0 Installation completed after 0.88s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 13.39s ################################################################################ # Testing # Testing NarrativeTest Status `/tmp/jl_sFY0LB/Project.toml` [9563631e] NarrativeTest v0.7.5 [8dfed614] Test v1.11.0 Status `/tmp/jl_sFY0LB/Manifest.toml` [9563631e] NarrativeTest v0.7.5 [2a0f44e3] Base64 v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [f489334b] StyledStrings v1.11.0 [8dfed614] Test v1.11.0 Testing Running tests... ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Test failed at ~/.julia/packages/NarrativeTest/3lL21/test/index.md:185 using Test NarrativeTest.testset([joinpath(@__DIR__, "sample_good.md_"), joinpath(@__DIR__, "sample_bad.md_")]) Expected output: ⋮ ERROR: Some tests did not pass: 4 passed, 2 failed, 1 errored, 0 broken. Actual output: ERROR: ConcurrencyViolationError("setfield!: atomic field cannot be written non-atomically") Stacktrace: [1] setproperty! @ ./Base_compiler.jl:61 [inlined] [2] testset(files::Vector{String}, cfg::NarrativeTest.Cfg) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:459 [3] testset(files::Vector{String}; default::Vector{String}, subs::Vector{Pair{Regex, SubstitutionString{String}}}, mod::Nothing, quiet::Bool, exitfirst::Bool) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:441 [4] top-level scope @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:187 [5] eval(m::Module, e::Any) @ Core ./boot.jl:489 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Test failed at ~/.julia/packages/NarrativeTest/3lL21/test/index.md:196 @testset begin @test true == false NarrativeTest.testset([joinpath(@__DIR__, "sample_good.md_"), joinpath(@__DIR__, "sample_bad.md_")]) @test 2 + 2 == 5 end Expected output: ⋮ ERROR: Some tests did not pass: 4 passed, 4 failed, 1 errored, 0 broken. Actual output: test set: Test Failed at /home/pkgeval/.julia/packages/NarrativeTest/3lL21/test/index.md:197 Expression: true == false Stacktrace: [1] top-level scope @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:197 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1952 [inlined] [3] macro expansion @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:197 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:751 [inlined] test set: Error During Test at /home/pkgeval/.julia/packages/NarrativeTest/3lL21/test/index.md:196 Got exception outside of a @test ConcurrencyViolationError("setfield!: atomic field cannot be written non-atomically") Stacktrace: [1] setproperty! @ ./Base_compiler.jl:61 [inlined] [2] testset(files::Vector{String}, cfg::NarrativeTest.Cfg) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:459 [3] testset(files::Vector{String}; default::Vector{String}, subs::Vector{Pair{Regex, SubstitutionString{String}}}, mod::Nothing, quiet::Bool, exitfirst::Bool) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:441 [4] top-level scope @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:197 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1952 [inlined] [6] macro expansion @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:198 [inlined] [7] eval(m::Module, e::Any) @ Core ./boot.jl:489 [8] macro expansion @ ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:749 [inlined] [9] macro expansion @ ./task.jl:633 [inlined] [10] runtest(test::NarrativeTest.TestCase, cfg::NarrativeTest.Cfg) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:715 [11] runtests(files::Vector{String}, cfg::NarrativeTest.Cfg) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:411 [12] runtests(; default::Vector{String}, subs::Vector{Pair{Regex, SubstitutionString{String}}}, mod::Nothing, quiet::Bool, exitfirst::Bool, maxfail::Nothing) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:398 [13] kwcall(::@NamedTuple{subs::Vector{Pair{Regex, SubstitutionString{String}}}}, ::typeof(runtests)) @ NarrativeTest ~/.julia/packages/NarrativeTest/3lL21/src/NarrativeTest.jl:359 [14] top-level scope @ ~/.julia/packages/NarrativeTest/3lL21/test/runtests.jl:20 [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:309 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [19] _start() @ Base ./client.jl:563 Test Summary: | Fail Error Total Time test set | 1 1 2 1.2s RNG of the outermost testset: Random.Xoshiro(0xa5ed6cbd4acf4539, 0xca872dbef016fff9, 0x05da6f7f4ccfd452, 0x5f807a83803408da, 0xbf4a7d0f1c8fa8b4) ERROR: Some tests did not pass: 0 passed, 1 failed, 1 errored, 0 broken. Stacktrace: [1] finish(ts::Test.DefaultTestSet; print_results::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1444 [2] finish(ts::Test.DefaultTestSet) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1417 [3] top-level scope @ ~/.julia/packages/NarrativeTest/3lL21/test/index.md:197 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1968 [inlined] [5] eval(m::Module, e::Any) @ Core ./boot.jl:489 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Test failed at ~/.julia/packages/NarrativeTest/3lL21/test/index.md:607 result = runtest(@__FILE__, "println(@__MODULE__)", expect=string(@__MODULE__)) display(result) Expected output: Test passed at …/index.md println(@__MODULE__) Expected output: IndexMd Actual output: IndexMd Actual output: Test passed at ~/.julia/packages/NarrativeTest/3lL21/test/index.md println(@__MODULE__) Expected output: Main.IndexMd Actual output: Main.IndexMd ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Tests passed: 48 Tests failed: 3 TESTING UNSUCCESSFUL! Testing failed after 97.0s ERROR: LoadError: Package NarrativeTest errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2673 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2522 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:538 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:515 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:168 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:157 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [9] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:155 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [12] include(mod::Module, _path::String) @ Base ./Base.jl:308 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:330 [14] _start() @ Base ./client.jl:563 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 135.54s: package tests unexpectedly errored