Package evaluation to test TestReports on Julia 1.11.8 (29b3528cce*) started at 2026-01-20T02:28:49.625 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.11` Set-up completed after 8.56s ################################################################################ # Installation # Installing TestReports... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [dcd651b4] + TestReports v1.3.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [8f5d6c58] + EzXML v1.2.3 [692b3bcd] + JLLWrappers v1.7.1 [21216c6a] + Preferences v1.5.1 [1e6cf692] + TestEnv v1.103.2 [dcd651b4] + TestReports v1.3.0 [94ce4f54] + Libiconv_jll v1.18.0+0 [02c8fc9c] + XML2_jll v2.15.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 1.78s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 18.71s ################################################################################ # Testing # Testing TestReports Status `/tmp/jl_74z4ZU/Project.toml` [8f5d6c58] EzXML v1.2.3 [324d217c] ReferenceTests v0.10.6 [1e6cf692] TestEnv v1.103.2 [dcd651b4] TestReports v1.3.0 [ade2ca70] Dates v1.11.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 Status `/tmp/jl_74z4ZU/Manifest.toml` [3da002f7] ColorTypes v0.12.1 [c3611d14] ColorVectorSpace v0.11.0 [5ae59095] Colors v0.13.1 [a8cc5b0e] Crayons v4.1.1 [ab62b9b5] DeepDiffs v1.2.0 [b4f34e82] Distances v0.10.12 [8f5d6c58] EzXML v1.2.3 [5789e2e9] FileIO v1.17.1 [53c48c17] FixedPointNumbers v0.8.5 [c817782e] ImageBase v0.1.7 [a09fc81d] ImageCore v0.10.5 [9b13fd28] IndirectArrays v1.0.0 [692b3bcd] JLLWrappers v1.7.1 [dbb5928d] MappedArrays v0.4.3 [e94cdb99] MosaicViews v0.3.4 [6fe1bfb0] OffsetArrays v1.17.0 [5432bcbf] PaddedViews v0.5.12 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.5.1 [189a3867] Reexport v1.2.2 [324d217c] ReferenceTests v0.10.6 [ae029012] Requires v1.3.1 [45858cf5] Sixel v0.1.5 [cae243ae] StackViews v0.1.2 [10745b16] Statistics v1.11.1 [82ae8749] StatsAPI v1.8.0 [62fd8b95] TensorCore v0.1.1 [1e6cf692] TestEnv v1.103.2 [dcd651b4] TestReports v1.3.0 [c8c2cc18] XTermColors v0.2.1 [aacddb02] JpegTurbo_jll v3.1.4+0 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.15.1+0 [b53b4c65] libpng_jll v1.6.54+0 [075b6546] libsixel_jll v1.10.5+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... WARNING: Method definition (::Type{Main.NoDescriptionTestSet})(Any) in module Main at /home/pkgeval/.julia/packages/TestReports/yVV91/test/utils.jl:168 overwritten at /home/pkgeval/.julia/packages/TestReports/yVV91/test/utils.jl:170. : Test Failed at none:1 Expression: 1 == 2 Stacktrace: [1] record(ts::DefaultTestSet, t::Union{Error, Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [inlined] [3] add_to_ts_default!(ts_default::DefaultTestSet, result::Fail) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:404 [4] macro expansion @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:111 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:107 : Error During Test at none:1 : Test Failed at none:1 Expression: 1 Stacktrace: [1] record(ts::DefaultTestSet, t::Union{Error, Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [inlined] [3] add_to_ts_default! @ ~/.julia/packages/TestReports/yVV91/src/testsets.jl:404 [inlined] [4] add_to_ts_default!(ts_default::DefaultTestSet, result::TestReports.ReportingResult{Fail}) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:403 [5] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [6] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [7] getindex @ ./broadcast.jl:610 [inlined] [8] copyto_nonleaf!(dest::Vector{Pass}, bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{DefaultTestSet}, Base.Broadcast.Extruded{Vector{Any}, Tuple{Bool}, Tuple{Int64}}}}, iter::Base.OneTo{Int64}, state::Int64, count::Int64) @ Base.Broadcast ./broadcast.jl:1082 [9] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:919 [10] materialize @ ./broadcast.jl:872 [inlined] [11] display_reporting_testset(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:369 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [13] macro expansion @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:131 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [15] top-level scope @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:107 : Test Failed at none:1 Expression: false Stacktrace: [1] record(ts::DefaultTestSet, t::Union{Error, Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record(ts::DefaultTestSet, t::Union{Error, Fail}) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [3] macro expansion @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:153 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:150 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/TestReports/yVV91/test/testsets.jl:139 Resolving package versions... Updating `/tmp/jl_LMRvja/Project.toml` [19d8228f] + CustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/CustomTestSet` Updating `/tmp/jl_LMRvja/Manifest.toml` [19d8228f] + CustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/CustomTestSet` Test Summary: | Pass Total Time ts4 | 2 2 0.3s Resolving package versions... Updating `/tmp/jl_V9QLC3/Project.toml` [19d8228f] + NoResultsCustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoResultsCustomTestSet` Updating `/tmp/jl_V9QLC3/Manifest.toml` [19d8228f] + NoResultsCustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoResultsCustomTestSet` [ Info: Testing NoResultsCustomTestSet ERROR: type NoResultsTestSet has no field results Stacktrace: [1] getproperty @ ./Base.jl:49 [inlined] [2] _flatten_results!(ts::NoResultsTestSet, depth::Int64) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:278 [3] _flatten_results!(ts::ReportingTestSet, depth::Int64) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:301 [4] flatten_results!(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:270 [5] top-level scope @ none:18 Resolving package versions... Updating `/tmp/jl_OuMpeM/Project.toml` [19d8228f] + NoDescriptionCustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoDescriptionCustomTestSet` Updating `/tmp/jl_OuMpeM/Manifest.toml` [19d8228f] + NoDescriptionCustomTestSet v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoDescriptionCustomTestSet` [ Info: Testing NoDescriptionCustomTestSet ERROR: type NoDescriptionTestSet has no field description Stacktrace: [1] getproperty @ ./Base.jl:49 [inlined] [2] (::TestReports.var"#inner!#2"{Vector{Test.Result}, NoDescriptionTestSet, Int64, Vector{AbstractTestSet}})(childts::NoDescriptionTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:294 [3] _flatten_results!(ts::NoDescriptionTestSet, depth::Int64) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:303 [4] _flatten_results!(ts::ReportingTestSet, depth::Int64) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:301 [5] flatten_results!(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:270 [6] top-level scope @ none:18 Resolving package versions... Updating `/tmp/jl_CZvVHb/Project.toml` [95d226fd] + TestsWithProperties v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProperties` Updating `/tmp/jl_CZvVHb/Manifest.toml` [95d226fd] + TestsWithProperties v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProperties` [ Info: Testing TestsWithProperties Test Summary: | Pass Total Time Outer | 4 4 0.7s Test Summary: | Pass Total Time Types | 1 1 0.1s [ Info: TestsWithProperties tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/testlog.xml. Resolving package versions... Updating `/tmp/jl_74z4ZU/Project.toml` [7876af07] + Example v0.5.5 Updating `/tmp/jl_74z4ZU/Manifest.toml` [7876af07] + Example v0.5.5 Updating `/tmp/jl_74z4ZU/Project.toml` [7876af07] - Example v0.5.5 Updating `/tmp/jl_74z4ZU/Manifest.toml` [7876af07] - Example v0.5.5 Info We haven't cleaned this depot up for a bit, running Pkg.gc()... Active manifest files: 3 found Active artifact files: 5 found Active scratchspaces: 0 found Deleted no artifacts, repos, packages or scratchspaces Activating project at `/tmp/jl_MrZdmP/PassingTests` No Changes to `/tmp/jl_MrZdmP/PassingTests/Project.toml` No Changes to `/tmp/jl_MrZdmP/PassingTests/Manifest.toml` Activating project at `/tmp/jl_mfJgJG/PassingTests` No Changes to `/tmp/jl_mfJgJG/PassingTests/Project.toml` No Changes to `/tmp/jl_mfJgJG/PassingTests/Manifest.toml` Resolving package versions... Updating `/tmp/jl_LsXTiO/Project.toml` [379d537f] + PassingTests v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/PassingTests` Updating `/tmp/jl_LsXTiO/Manifest.toml` [379d537f] + PassingTests v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/PassingTests` [ Info: Testing PassingTests ERROR: unknown option `--doesnt-exist` Resolving package versions... Updating `/tmp/jl_fjAnKU/Project.toml` [b111998f] + FailedTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/FailedTest` Updating `/tmp/jl_fjAnKU/Manifest.toml` [b111998f] + FailedTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/FailedTest` [ Info: Testing FailedTest : Test Failed at /home/pkgeval/.julia/packages/TestReports/yVV91/test/test_packages/FailedTest/test/runtests.jl:3 Expression: false Stacktrace: [1] record(ts::Test.DefaultTestSet, t::Union{Test.Error, Test.Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [inlined] [3] add_to_ts_default! @ ~/.julia/packages/TestReports/yVV91/src/testsets.jl:404 [inlined] [4] add_to_ts_default!(ts_default::Test.DefaultTestSet, result::TestReports.ReportingResult{Test.Fail}) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:403 [5] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [6] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [7] getindex @ ./broadcast.jl:610 [inlined] [8] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:911 [9] materialize @ ./broadcast.jl:872 [inlined] [10] display_reporting_testset(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:369 [11] finish(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:109 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1725 [inlined] [13] top-level scope @ none:14 ┌ Warning: ERROR: Test(s) failed or had an error in FailedTest └ @ TestReports ~/.julia/packages/TestReports/yVV91/src/runner.jl:216 Resolving package versions... Updating `/tmp/jl_6rTwBN/Project.toml` [ab7034c0] + FailedNestedTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/FailedNestedTest` Updating `/tmp/jl_6rTwBN/Manifest.toml` [ab7034c0] + FailedNestedTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/FailedNestedTest` [ Info: Testing FailedNestedTest nested: Test Failed at /home/pkgeval/.julia/packages/TestReports/yVV91/test/test_packages/FailedNestedTest/test/runtests.jl:7 Expression: false Stacktrace: [1] record(ts::Test.DefaultTestSet, t::Union{Test.Error, Test.Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [inlined] [3] add_to_ts_default! @ ~/.julia/packages/TestReports/yVV91/src/testsets.jl:404 [inlined] [4] add_to_ts_default!(ts_default::Test.DefaultTestSet, result::TestReports.ReportingResult{Test.Fail}) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:403 [5] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [6] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [7] getindex @ ./broadcast.jl:610 [inlined] [8] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:911 [9] materialize @ ./broadcast.jl:872 [inlined] [10] add_to_ts_default!(ts_default::Test.DefaultTestSet, ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:413 [11] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [12] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [13] getindex @ ./broadcast.jl:610 [inlined] [14] copyto_nonleaf!(dest::Vector{Test.Pass}, bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Base.Broadcast.Extruded{Vector{Any}, Tuple{Bool}, Tuple{Int64}}}}, iter::Base.OneTo{Int64}, state::Int64, count::Int64) @ Base.Broadcast ./broadcast.jl:1082 [15] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:919 [16] materialize @ ./broadcast.jl:872 [inlined] [17] add_to_ts_default!(ts_default::Test.DefaultTestSet, ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:413 [18] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [19] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [20] getindex @ ./broadcast.jl:610 [inlined] [21] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:911 [22] materialize @ ./broadcast.jl:872 [inlined] [23] display_reporting_testset(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:369 [24] finish(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:109 [25] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1725 [inlined] [26] top-level scope @ none:14 Test Summary: | Pass Fail Total Time FailedNestedTest | 1 1 2 0.5s nested | 1 1 0.4s ┌ Warning: ERROR: Test(s) failed or had an error in FailedNestedTest └ @ TestReports ~/.julia/packages/TestReports/yVV91/src/runner.jl:216 Resolving package versions... Updating `/tmp/jl_n4lDbx/Project.toml` [34ecfee6] + ErroredTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/ErroredTest` Updating `/tmp/jl_n4lDbx/Manifest.toml` [34ecfee6] + ErroredTest v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/ErroredTest` [ Info: Testing ErroredTest : Error During Test at /home/pkgeval/.julia/packages/TestReports/yVV91/test/test_packages/ErroredTest/test/runtests.jl:3 Test threw exception Expression: error("ErroredTest error") ErroredTest error Stacktrace: [1] error(s::String) @ Base ./error.jl:35 [2] macro expansion @ ~/.julia/packages/TestReports/yVV91/test/test_packages/ErroredTest/test/runtests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [4] top-level scope @ ~/.julia/packages/TestReports/yVV91/test/test_packages/ErroredTest/test/runtests.jl:516 ┌ Warning: ERROR: Test(s) failed or had an error in ErroredTest └ @ TestReports ~/.julia/packages/TestReports/yVV91/src/runner.jl:216 Resolving package versions... Updating `/tmp/jl_GWnfb0/Project.toml` [5aa360a4] + NoTestFile v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoTestFile` Updating `/tmp/jl_GWnfb0/Manifest.toml` [5aa360a4] + NoTestFile v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/NoTestFile` Resolving package versions... Updating `/tmp/jl_qjVcnb/Project.toml` [3ef0d59a] + TestsWithDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithDeps` Updating `/tmp/jl_qjVcnb/Manifest.toml` [7876af07] + Example v0.5.5 [3ef0d59a] + TestsWithDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithDeps` Resolving package versions... Updating `/tmp/jl_h9iCwJ/Project.toml` [3ef0d59a] + TestsWithTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithTestDeps` Updating `/tmp/jl_h9iCwJ/Manifest.toml` [3ef0d59a] + TestsWithTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithTestDeps` Resolving package versions... Updating `/tmp/jl_hOCqxo/Project.toml` [75affb0d] + TestsWithProjectFile v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProjectFile` Updating `/tmp/jl_hOCqxo/Manifest.toml` [75affb0d] + TestsWithProjectFile v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProjectFile` Resolving package versions... Updating `/tmp/jl_xfFdzV/Project.toml` [e84797c4] + TestsWithProjectFileWithTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProjectFileWithTestDeps` Updating `/tmp/jl_xfFdzV/Manifest.toml` [e84797c4] + TestsWithProjectFileWithTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestsWithProjectFileWithTestDeps` Resolving package versions... Updating `/tmp/jl_zBdcx3/Project.toml` [265b0eca] + TestArguments v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestArguments` Updating `/tmp/jl_zBdcx3/Manifest.toml` [265b0eca] + TestArguments v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/TestArguments` Precompiling TestReports... 837.5 ms ✓ nghttp2_jll 598.1 ms ✓ p7zip_jll 542.7 ms ✓ MozillaCACerts_jll 722.9 ms ✓ MbedTLS_jll 742.7 ms ✓ Zlib_jll 819.1 ms ✓ NetworkOptions 2698.2 ms ✓ ArgTools 1115.0 ms ✓ Libiconv_jll 786.4 ms ✓ LibSSH2_jll 1230.8 ms ✓ Tar 1388.9 ms ✓ XML2_jll 728.5 ms ✓ LibGit2_jll 766.8 ms ✓ LibCURL_jll 1816.0 ms ✓ EzXML 4121.3 ms ✓ LibGit2 1871.9 ms ✓ LibCURL 6220.7 ms ✓ Downloads 92938.3 ms ✓ Pkg 3241.1 ms ✓ TestEnv 6523.9 ms ✓ TestReports 20 dependencies successfully precompiled in 130 seconds. 13 already precompiled. Resolving package versions... Updating `/tmp/jl_74z4ZU/Project.toml` [7876af07] + Example v0.5.5 Updating `/tmp/jl_74z4ZU/Manifest.toml` [7876af07] + Example v0.5.5 [ Info: Testing Example [ Info: Example tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/testlog.xml. [ Info: Testing Example [ Info: Example tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/NonExistentDir/changedname.xml. Updating `/tmp/jl_74z4ZU/Project.toml` [7876af07] - Example v0.5.5 Updating `/tmp/jl_74z4ZU/Manifest.toml` [7876af07] - Example v0.5.5 Resolving package versions... Updating `/tmp/jl_CGEp3t/Project.toml` [379d537f] + PassingTests v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/PassingTests` Updating `/tmp/jl_CGEp3t/Manifest.toml` [379d537f] + PassingTests v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/PassingTests` Resolving package versions... Updating `/tmp/jl_CGEp3t/Project.toml` [7876af07] + Example v0.5.5 Updating `/tmp/jl_CGEp3t/Manifest.toml` [7876af07] + Example v0.5.5 [ Info: Testing Example [ Info: Example tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/Example_testlog.xml. [ Info: Testing PassingTests [ Info: PassingTests tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/PassingTests_testlog.xml. [ Info: Testing Example [ Info: Example tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/testlog1.xml. [ Info: Testing PassingTests [ Info: PassingTests tests passed. Results saved to /home/pkgeval/.julia/packages/TestReports/yVV91/test/testlog2.xml. Resolving package versions... Updating `/tmp/jl_kqP1cB/Project.toml` [19d8228f] + OldTestReportsInTarget v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTarget` Updating `/tmp/jl_kqP1cB/Manifest.toml` [19d8228f] + OldTestReportsInTarget v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTarget` Resolving package versions... Updating `/tmp/jl_9SglsZ/Project.toml` [19d8228f] + OldTestReportsInDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInDeps` Updating `/tmp/jl_9SglsZ/Manifest.toml` [8f5d6c58] + EzXML v1.2.3 [692b3bcd] + JLLWrappers v1.7.1 [19d8228f] + OldTestReportsInDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInDeps` [21216c6a] + Preferences v1.5.1 ⌃ [dcd651b4] + TestReports v0.3.3 [94ce4f54] + Libiconv_jll v1.18.0+0 [02c8fc9c] + XML2_jll v2.15.1+0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Resolving package versions... Updating `/tmp/jl_yTOdcc/Project.toml` [19d8228f] + OldDepInTarget v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTarget` Updating `/tmp/jl_yTOdcc/Manifest.toml` [19d8228f] + OldDepInTarget v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTarget` Resolving package versions... Updating `/tmp/jl_prX7oo/Project.toml` [19d8228f] + OldTestReportsInTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTestDeps` Updating `/tmp/jl_prX7oo/Manifest.toml` [19d8228f] + OldTestReportsInTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTestDeps` Resolving package versions... Updating `/tmp/jl_WVdCZj/Project.toml` [19d8228f] + OldDepInTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTestDeps` Updating `/tmp/jl_WVdCZj/Manifest.toml` [19d8228f] + OldDepInTestDeps v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTestDeps` Resolving package versions... Updating `/tmp/jl_ekbeKt/Project.toml` [19d8228f] + OldTestReportsInTestManifest_1_7 v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTestManifest_1_7` Updating `/tmp/jl_ekbeKt/Manifest.toml` [19d8228f] + OldTestReportsInTestManifest_1_7 v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldTestReportsInTestManifest_1_7` Resolving package versions... Updating `/tmp/jl_jZsoUw/Project.toml` [19d8228f] + OldDepInTestManifest_1_7 v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTestManifest_1_7` Updating `/tmp/jl_jZsoUw/Manifest.toml` [19d8228f] + OldDepInTestManifest_1_7 v0.1.0 `~/.julia/packages/TestReports/yVV91/test/test_packages/OldDepInTestManifest_1_7` Generate a JUnit test report from running Julia tests. Usage: reporttests.jl TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] julia reporttests.jl -- TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] Generate a JUnit test report from running Julia tests. Usage: reporttests.jl TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] julia reporttests.jl -- TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] Generate a JUnit test report from running Julia tests. Usage: reporttests.jl TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] julia reporttests.jl -- TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] Precompiling TestReports... 3580.3 ms ✓ TestEnv 4288.7 ms ✓ TestReports 2 dependencies successfully precompiled in 8 seconds. 31 already precompiled. Generate a JUnit test report from running Julia tests. Usage: reporttests.jl TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] julia reporttests.jl -- TEST_FILENAME [--output=LOG_FILENAME] -- [test_args...] Precompiling TestReports... 1861.7 ms ✓ Preferences 4001.3 ms ✓ TestEnv 1131.9 ms ✓ JLLWrappers 1377.3 ms ✓ Libiconv_jll 1531.6 ms ✓ XML2_jll 2201.0 ms ✓ EzXML 5075.5 ms ✓ TestReports 7 dependencies successfully precompiled in 17 seconds. 26 already precompiled. Test Summary: | Pass Total Time reporttest | 1 1 0.6s Test Summary: | Pass Total Time reporttest | 1 1 0.7s reporttest: Test Failed at /home/pkgeval/.julia/packages/TestReports/yVV91/test/reporttests_testsets.jl:4 Expression: ARGS == [] Evaluated: ["foo", "-e", "bar"] == Any[] Stacktrace: [1] record(ts::Test.DefaultTestSet, t::Union{Test.Error, Test.Fail}; print_result::Bool) @ Test /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1112 [2] record @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1105 [inlined] [3] add_to_ts_default! @ ~/.julia/packages/TestReports/yVV91/src/testsets.jl:404 [inlined] [4] add_to_ts_default!(ts_default::Test.DefaultTestSet, result::TestReports.ReportingResult{Test.Fail}) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:403 [5] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [6] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [7] getindex @ ./broadcast.jl:610 [inlined] [8] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:911 [9] materialize @ ./broadcast.jl:872 [inlined] [10] add_to_ts_default!(ts_default::Test.DefaultTestSet, ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:413 [11] _broadcast_getindex_evalf @ ./broadcast.jl:678 [inlined] [12] _broadcast_getindex @ ./broadcast.jl:651 [inlined] [13] getindex @ ./broadcast.jl:610 [inlined] [14] copy(bc::Base.Broadcast.Broadcasted{Base.Broadcast.DefaultArrayStyle{1}, Tuple{Base.OneTo{Int64}}, typeof(TestReports.add_to_ts_default!), Tuple{Base.RefValue{Test.DefaultTestSet}, Vector{Any}}}) @ Base.Broadcast ./broadcast.jl:911 [15] materialize @ ./broadcast.jl:872 [inlined] [16] display_reporting_testset(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:369 [17] finish(ts::ReportingTestSet) @ TestReports ~/.julia/packages/TestReports/yVV91/src/testsets.jl:109 [18] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1725 [inlined] [19] top-level scope @ none:14 Test Summary: | Fail Total Time reporttest | 1 1 1.0s Test Summary: | Pass Total Time TestReports | 263 263 9m32.9s Testing TestReports tests passed Testing completed after 586.8s PkgEval succeeded after 628.42s