Package evaluation of ReTestItems on Julia 1.12.0-rc2.1 (084dab1917*) started at 2025-09-12T02:26:35.815 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 7.88s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [817f1d60] + ReTestItems v1.33.2 Updating `~/.julia/environments/v1.12/Manifest.toml` [817f1d60] + ReTestItems v1.33.2 [1e6cf692] + TestEnv v1.102.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.5.0+2 Installation completed after 0.88s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 21.16s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_NhYwWR/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.33.2 [1e6cf692] TestEnv v1.102.2 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.12.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_NhYwWR/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.2 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.1 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.5.0 [817f1d60] ReTestItems v1.33.2 [1e6cf692] TestEnv v1.102.2 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.14.4+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... Worker 28: [28] signal 15: Terminated Worker 33: [33] signal 15: Terminated Worker 43: [43] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:138 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:138 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:142 02:28:35 | maxrss 1.5% | mem 1.6% | SKIP (0/1) test item "skip" at internals.jl:289 02:28:40 | maxrss 1.5% | mem 1.7% | START test item "TI1" at macros.jl:32 02:28:40 | maxrss 1.5% | mem 1.7% | DONE test item "TI1" 0.2 secs (98.1% compile), 89.11 K allocs (5.265 MB) 02:28:40 | maxrss 1.5% | mem 1.7% | START test item "TI2" at macros.jl:43 02:28:40 | maxrss 1.5% | mem 1.7% | DONE test item "TI2" <0.1 secs (<0.1% compile), 967 allocs (54.768 KB) 02:28:40 | maxrss 1.5% | mem 1.7% | START test item "TI" at macros.jl:53 02:28:40 | maxrss 1.5% | mem 1.7% | DONE test item "TI" <0.1 secs (<0.1% compile), 967 allocs (54.800 KB) 02:28:41 | maxrss 1.5% | mem 1.7% | START test item "macro-import" at macros.jl:64 02:28:42 | maxrss 1.5% | mem 1.7% | DONE test item "macro-import" 1.7 secs (99.3% compile, 1.8% GC), 623.12 K allocs (36.202 MB) 02:28:42 | maxrss 1.5% | mem 1.7% | START test item "Foo" at macros.jl:95 02:28:43 | maxrss 1.5% | mem 1.7% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.81 K allocs (126.544 KB) 02:28:43 | maxrss 1.5% | mem 1.7% | START test item "Foo3" at macros.jl:110 02:28:43 | maxrss 1.5% | mem 1.7% | DONE test item "Foo3" <0.1 secs (<0.1% compile), 1.95 K allocs (92.128 KB) 02:28:43 | maxrss 1.5% | mem 1.7% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:109 [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [8] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [9] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [10] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1023 [11] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/macros.jl:23 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/macros.jl:118 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/macros.jl:123 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [17] IncludeInto @ ./Base.jl:307 [inlined] [18] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:20 [19] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [20] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [23] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [24] top-level scope @ none:6 [25] eval(m::Module, e::Any) @ Core ./boot.jl:489 [26] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [27] _start() @ Base ./client.jl:554 02:28:47 | maxrss 1.7% | mem 1.8% | DONE test item "Foo4" 02:28:48 | maxrss 1.7% | mem 1.8% | START test item "testitem active" at macros.jl:138 02:28:48 | maxrss 1.7% | mem 1.8% | DONE test item "testitem active" <0.1 secs (82.2% compile), 2.89 K allocs (159.312 KB) 02:28:48 | maxrss 1.7% | mem 1.8% | START test item "run" at macros.jl:146 02:28:48 | maxrss 1.7% | mem 1.8% | DONE test item "run" <0.1 secs (<0.1% compile), 965 allocs (54.608 KB) 02:28:49 | maxrss 1.7% | mem 1.8% | START test item "comparisons" at macros.jl:182 02:28:49 | maxrss 1.7% | mem 1.8% | DONE test item "comparisons" 0.1 secs (81.6% compile), 34.53 K allocs (2.087 MB) 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip isa bool" at macros.jl:306 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "test contains error" at macros.jl:314 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip isa expr 1" at macros.jl:335 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip isa expr 2" at macros.jl:345 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip expr loads module" at macros.jl:362 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip expr defines variable" at macros.jl:371 02:28:52 | maxrss 1.7% | mem 1.8% | SKIP test item "skip expr defines variable" at macros.jl:371 02:28:52 | maxrss 1.7% | mem 1.8% | START test item "default_imports" at macros.jl:424 02:28:52 | maxrss 1.7% | mem 1.8% | DONE test item "default_imports" <0.1 secs (<0.1% compile), 1.44 K allocs (72.240 KB) 02:28:52 | maxrss 1.7% | mem 1.8% | START test item "no_default_imports" at macros.jl:432 02:28:53 | maxrss 1.7% | mem 1.8% | DONE test item "no_default_imports" 0.2 secs (99.4% compile), 432.00 K allocs (25.510 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/3F3Hj` Updating `~/.julia/packages/ReTestItems/3F3Hj/Project.toml` [1e6cf692] + TestEnv v1.102.2 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.12.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/3F3Hj/Manifest.toml` [1e6cf692] + TestEnv v1.102.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] ~ Pkg ⇒ v1.12.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.5.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:24 | maxrss 1.9% | mem 2.0% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 02:29:24 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.28 K allocs (72.368 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:24 | maxrss 1.9% | mem 2.0% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 02:29:24 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.21 K allocs (66.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_nested [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:24 | maxrss 1.9% | mem 2.0% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 02:29:24 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.21 K allocs (68.160 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` 02:29:27 | maxrss 1.9% | mem 2.0% | START (1/1) test item "foo" at src/foo_test.jl:1 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "foo" 0.8 secs (2.3% compile), 59.41 K allocs (7.679 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 19 02:29:28 | maxrss 1.9% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.82 K allocs (127.992 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (60.704 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (60.736 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 02:29:28 | maxrss 1.9% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.784 KB) 02:29:28 | maxrss 1.9% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 02:29:29 | maxrss 1.9% | mem 2.0% | DONE (7/8) test item "bar" 0.6 secs (97.6% compile), 332.39 K allocs (18.314 MB) 02:29:29 | maxrss 1.9% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 02:29:29 | maxrss 1.9% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (82.240 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.95 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:32 | maxrss 1.9% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 02:29:32 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (172.072 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.98 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:34 | maxrss 1.9% | mem 2.0% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 02:29:34 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.07 seconds. [ Info: Scheduling 1 tests on pid 19 02:29:36 | maxrss 1.9% | mem 2.0% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 02:29:36 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.28 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 19 02:29:41 | maxrss 1.9% | mem 2.0% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 02:29:41 | maxrss 1.9% | mem 2.0% | DONE (1/5) test item "scope test - loops" <0.1 secs (<0.1% compile), 1.38 K allocs (73.792 KB) 02:29:41 | maxrss 1.9% | mem 2.0% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 02:29:41 | maxrss 1.9% | mem 2.0% | DONE (2/5) test item "scope test - setups" <0.1 secs (<0.1% compile), 1.51 K allocs (79.840 KB) 02:29:41 | maxrss 1.9% | mem 2.0% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 02:29:41 | maxrss 1.9% | mem 2.0% | DONE (3/5) test item "scope test - testsets" <0.1 secs (<0.1% compile), 2.76 K allocs (126.312 KB) 02:29:41 | maxrss 1.9% | mem 2.0% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 02:29:42 | maxrss 1.9% | mem 2.0% | DONE (4/5) test item "scope test - imports" <0.1 secs (61.3% compile), 7.25 K allocs (345.688 KB) 02:29:42 | maxrss 1.9% | mem 2.0% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 02:29:42 | maxrss 1.9% | mem 2.0% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.69 K allocs (127.576 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl/Manifest.toml:0 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing NoDeps Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_jjPvuz/Project.toml` [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_jjPvuz/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_jjPvuz/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [8dfed614] Test v1.11.0 Status `/tmp/jl_jjPvuz/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.53 seconds. [ Info: Scheduling 2 tests on pid 68 02:30:08 | maxrss 1.9% | mem 3.0% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 02:30:09 | maxrss 1.9% | mem 3.0% | DONE (1/2) test item "toplevel" 0.2 secs (97.3% compile), 16.42 K allocs (879.360 KB) 02:30:09 | maxrss 1.9% | mem 3.0% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 02:30:09 | maxrss 1.9% | mem 3.0% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (95.4% compile), 43.91 K allocs (2.617 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 68 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.7s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.0s Testing NoDeps tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing TestsInSrc Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_oX76Y9/Project.toml` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_oX76Y9/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.2 [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_oX76Y9/Project.toml` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_oX76Y9/Manifest.toml` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] TestEnv v1.102.2 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.74 seconds. [ Info: Scheduling 8 tests on pid 72 02:30:33 | maxrss 1.9% | mem 3.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 02:30:33 | maxrss 1.9% | mem 3.0% | DONE (1/8) test item "a1" 0.2 secs (97.0% compile), 17.01 K allocs (930.200 KB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (2/8) test item "a2" 0.2 secs (94.4% compile), 43.85 K allocs (2.611 MB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.00 K allocs (57.472 KB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.00 K allocs (56.768 KB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.00 K allocs (56.832 KB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.00 K allocs (56.576 KB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (7/8) test item "bar" 0.7 secs (97.2% compile), 334.87 K allocs (18.444 MB) 02:30:34 | maxrss 1.9% | mem 3.0% | START (8/8) test item "foo" at src/foo_test.jl:1 02:30:34 | maxrss 1.9% | mem 3.0% | DONE (8/8) test item "foo" <0.1 secs (76.0% compile), 3.41 K allocs (176.240 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.7s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.0s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.7s bar values | 2 2 0.2s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing TestProjectFile Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_RX3Eyd/Project.toml` [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_RX3Eyd/Manifest.toml` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [69de0a69] ↑ Parsers v2.5.8 ⇒ v2.8.3 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] ↑ Preferences v1.3.0 ⇒ v1.5.0 [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [66db9d55] - SnoopPrecompile v1.0.3 [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.2 [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_RX3Eyd/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_RX3Eyd/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.0 [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] TestEnv v1.102.2 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 1112.6 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.62 seconds. [ Info: Scheduling 1 tests on pid 76 02:30:59 | maxrss 2.0% | mem 2.9% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 02:31:02 | maxrss 2.0% | mem 3.0% | DONE (1/1) test item "TestProjectFile" 2.9 secs (55.1% compile, 24.8% recompile), 1.11 M allocs (67.611 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 76 Precompiling packages... 1121.1 ms ✓ InlineStrings 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 6.3s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.9s test-only dep on InlineStrings | 1 1 2.5s Testing TestProjectFile tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing TestEndExpr Status `/tmp/jl_OXYHIZ/Project.toml` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_OXYHIZ/Manifest.toml` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [loaded: v1.102.2] [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling packages... 4286.3 ms ✓ TestEnv 6260.7 ms ✓ ReTestItems 2 dependencies successfully precompiled in 11 seconds. 28 already precompiled. Precompiling packages... 802.4 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 30 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.5 seconds. [ Info: Scheduling 2 tests on pid 88 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 104: [ Info: Starting test worker 1 on pid = 104, with 2 threads [ Info: Starting running test items Worker 104: 02:31:59 | maxrss 1.6% | mem 3.7% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 104: 02:32:00 | maxrss 1.6% | mem 3.7% | DONE (1/2) test item "correct usage" 0.4 secs (97.9% compile), 75.78 K allocs (4.325 MB) Worker 104: 02:32:01 | maxrss 1.6% | mem 3.7% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 104: 02:32:01 | maxrss 1.6% | mem 3.7% | DONE (2/2) test item "incorrect usage" <0.1 secs (78.3% compile), 2.44 K allocs (133.744 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=104). [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 28.2s Testing TestEndExpr tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing DontPass Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_cC5jLg/Project.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_cC5jLg/Manifest.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.13.1+1 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_cC5jLg/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [37e2e46d] LinearAlgebra v1.12.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_cC5jLg/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+1 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... Precompiling packages... 805.4 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 30 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.59 seconds. [ Info: Scheduling 9 tests on pid 111 02:32:28 | maxrss 2.0% | mem 3.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 02:32:29 | maxrss 2.0% | mem 3.0% | DONE (1/9) test item "do_thing Pass" 0.7 secs (99.1% compile), 210.70 K allocs (11.321 MB) 02:32:29 | maxrss 2.0% | mem 3.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 02:32:29 | maxrss 2.0% | mem 3.0% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.5% compile), 105.20 K allocs (6.235 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 111 Error in testset "do_thing Fail" on worker 111: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.641202037809789, 0.16803822466983598, 0.8009525406775733] == 1 02:32:30 | maxrss 2.0% | mem 3.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 02:32:35 | maxrss 2.0% | mem 3.0% | DONE (3/9) test item "do_thing Error" 4.5 secs (93.5% compile, 2.3% recompile, 2.8% GC), 4.08 M allocs (243.846 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 111 Error in testset "do_thing Error" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 02:32:35 | maxrss 2.0% | mem 3.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 02:32:35 | maxrss 2.0% | mem 3.0% | DONE (4/9) test item "bad setup, good test" 0.6 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 111 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 111 Error in testset "bad setup, good test" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:362 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] #runtests#33 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:259 [inlined] [25] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:256 [inlined] [26] #runtests#32 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:255 [inlined] [27] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [29] top-level scope @ none:6 [30] eval(m::Module, e::Any) @ Core ./boot.jl:489 [31] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [32] _start() @ Base ./client.jl:554 02:32:35 | maxrss 2.0% | mem 3.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 02:32:35 | maxrss 2.0% | mem 3.0% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 111 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 111 Error in testset "bad setup, bad test" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:362 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] #runtests#33 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:259 [inlined] [25] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:256 [inlined] [26] #runtests#32 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:255 [inlined] [27] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [29] top-level scope @ none:6 [30] eval(m::Module, e::Any) @ Core ./boot.jl:489 [31] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [32] _start() @ Base ./client.jl:554 02:32:35 | maxrss 2.0% | mem 3.0% | START (6/9) test item "errors" at test/error_tests.jl:1 02:32:37 | maxrss 2.0% | mem 3.1% | DONE (6/9) test item "errors" 1.8 secs (97.1% compile), 540.74 K allocs (32.222 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 111 Error in testset "UndefVarError" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#295"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#295"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [10] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [11] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [12] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [13] redirect_stdio @ ./stream.jl:1410 [inlined] [14] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [15] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [16] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [17] open @ ./io.jl:407 [inlined] [18] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [19] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [20] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [21] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [22] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [23] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:362 [24] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [25] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [26] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [27] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [28] #runtests#33 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:259 [inlined] [29] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:256 [inlined] [30] #runtests#32 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:255 [inlined] [31] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [32] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [33] top-level scope @ none:6 [34] eval(m::Module, e::Any) @ Core ./boot.jl:489 [35] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [36] _start() @ Base ./client.jl:554 02:32:37 | maxrss 2.0% | mem 3.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 02:32:37 | maxrss 2.0% | mem 3.1% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 111 Error in testset "errors at the top level" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:362 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] #runtests#33 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:259 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:256 [inlined] [24] #runtests#32 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:255 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [30] _start() @ Base ./client.jl:554 02:32:37 | maxrss 2.0% | mem 3.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 02:32:38 | maxrss 2.0% | mem 3.1% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 111 Error in testset "nonexistent test setup" on worker 111: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:362 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] #runtests#33 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:259 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:256 [inlined] [24] #runtests#32 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:255 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [30] _start() @ Base ./client.jl:554 02:32:38 | maxrss 2.0% | mem 3.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 02:32:38 | maxrss 2.0% | mem 3.1% | DONE (9/9) test item "failures" <0.1 secs (71.4% compile), 5.01 K allocs (257.344 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 111 Error in testset "failures" on worker 111: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 111: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.0539014874531666 < 0 Error in testset "failures" on worker 111: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 13.4s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 4.5s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.6s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 2.0s UndefVarError | 2 2 1.4s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.2s errors at the top level | 1 1 2 0.2s nonexistent test setup | 1 1 0.1s test/failure_tests.jl | 3 3 failures | 3 3 0.0s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:32:40 | maxrss 2.0% | mem 2.0% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.07 K allocs (61.712 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.61 K allocs (119.928 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 19 02:32:40 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (61.424 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.81 K allocs (127.368 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (60.976 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.07 K allocs (173.256 KB) 02:32:40 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 02:32:40 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.66 K allocs (83.520 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:32:40 | maxrss 2.0% | mem 2.1% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 02:32:41 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "TestProjectFile" 0.8 secs (84.5% compile, 83.4% recompile), 593.18 K allocs (35.546 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 19 02:32:58 | maxrss 2.1% | mem 2.1% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 02:32:58 | maxrss 2.1% | mem 2.1% | DONE (1/9) test item "do_thing Pass" <0.1 secs (78.4% compile), 14.12 K allocs (807.576 KB) 02:32:58 | maxrss 2.1% | mem 2.1% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 02:32:58 | maxrss 2.1% | mem 2.1% | DONE (2/9) test item "do_thing Fail" 0.5 secs (99.1% compile), 326.61 K allocs (19.470 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 19 Error in testset "do_thing Fail" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.13288437895732563, 0.8362405291160685, 0.8509750602352231] == 1 02:32:59 | maxrss 2.1% | mem 2.1% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 02:33:01 | maxrss 2.1% | mem 2.1% | DONE (3/9) test item "do_thing Error" 1.8 secs (94.2% compile, 4.9% recompile, 3.7% GC), 2.50 M allocs (150.519 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 19 Error in testset "do_thing Error" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 02:33:01 | maxrss 2.1% | mem 2.1% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 02:33:01 | maxrss 2.1% | mem 2.1% | DONE (4/9) test item "bad setup, good test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 19 Error in testset "bad setup, good test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:280 [25] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [26] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [27] #305 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:225 [inlined] [28] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#with_test_package##4#with_test_package##5"{var"#305#306"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [30] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#with_test_package##2#with_test_package##3"{var"#305#306"}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [35] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#305#306", String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#305#306", name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [37] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:194 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [44] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [45] IncludeInto @ ./Base.jl:307 [inlined] [46] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [47] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [50] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [51] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [52] top-level scope @ none:6 [53] eval(m::Module, e::Any) @ Core ./boot.jl:489 [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:33:01 | maxrss 2.1% | mem 2.1% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 02:33:01 | maxrss 2.1% | mem 2.1% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 19 Error in testset "bad setup, bad test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:280 [25] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [26] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [27] #305 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:225 [inlined] [28] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#with_test_package##4#with_test_package##5"{var"#305#306"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [30] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#with_test_package##2#with_test_package##3"{var"#305#306"}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [35] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#305#306", String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#305#306", name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [37] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:194 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [44] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [45] IncludeInto @ ./Base.jl:307 [inlined] [46] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [47] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [50] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [51] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [52] top-level scope @ none:6 [53] eval(m::Module, e::Any) @ Core ./boot.jl:489 [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:33:01 | maxrss 2.1% | mem 2.1% | START (6/9) test item "errors" at test/error_tests.jl:1 02:33:02 | maxrss 2.1% | mem 2.1% | DONE (6/9) test item "errors" 0.2 secs (74.9% compile), 67.33 K allocs (4.498 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 19 Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#486"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#486"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [10] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [11] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [12] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [13] redirect_stdio @ ./stream.jl:1410 [inlined] [14] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [15] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [16] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [17] open @ ./io.jl:407 [inlined] [18] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [19] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [20] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [21] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [22] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [23] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [24] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [25] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [26] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [27] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [28] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:280 [29] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [30] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [31] #305 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:225 [inlined] [32] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [33] activate(f::var"#with_test_package##4#with_test_package##5"{var"#305#306"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [34] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [35] cd(f::var"#with_test_package##2#with_test_package##3"{var"#305#306"}, dir::String) @ Base.Filesystem ./file.jl:112 [36] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#305#306", String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [40] with_test_package(f::var"#305#306", name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [41] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:194 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [45] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [49] IncludeInto @ ./Base.jl:307 [inlined] [50] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [51] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [52] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [54] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [55] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [56] top-level scope @ none:6 [57] eval(m::Module, e::Any) @ Core ./boot.jl:489 [58] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:33:02 | maxrss 2.1% | mem 2.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 02:33:02 | maxrss 2.1% | mem 2.1% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 19 Error in testset "errors at the top level" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:280 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [24] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [25] #305 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:225 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#305#306"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#305#306"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#305#306", String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#305#306", name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [35] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:194 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [43] IncludeInto @ ./Base.jl:307 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:33:02 | maxrss 2.1% | mem 2.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 02:33:02 | maxrss 2.1% | mem 2.1% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 19 Error in testset "nonexistent test setup" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:280 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [24] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [25] #305 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:225 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#305#306"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#305#306"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#305#306", String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#305#306", name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [35] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:194 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [43] IncludeInto @ ./Base.jl:307 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:33:02 | maxrss 2.1% | mem 2.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 02:33:02 | maxrss 2.1% | mem 2.1% | DONE (9/9) test item "failures" <0.1 secs (73.1% compile), 5.08 K allocs (262.208 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 19 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.5072045220336149 < 0 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 19 Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:12 | maxrss 2.1% | mem 2.2% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 02:39:15 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "MonoRepo tests" 3.0 secs (<0.1% compile, 0.3% GC), 82.81 K allocs (9.897 MB) [ Tests Completed: 1/1 test items were run. ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 Testing C Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_7YhIN2/Project.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_7YhIN2/Manifest.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/3F3Hj` ⇒ v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.11.1+1 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_7YhIN2/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [8dfed614] Test v1.11.0 Status `/tmp/jl_7YhIN2/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.33.2 `~/.julia/packages/ReTestItems/3F3Hj` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.11.1+1 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.48 seconds. [ Info: Scheduling 1 tests on pid 218 02:39:38 | maxrss 2.1% | mem 3.2% | START (1/1) test item "C_tests" at test/c_tests.jl:1 02:39:38 | maxrss 2.1% | mem 3.2% | DONE (1/1) test item "C_tests" 0.3 secs (96.1% compile), 50.98 K allocs (2.944 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 4.1s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.3s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:40 | maxrss 2.2% | mem 2.2% | START (1/1) test item "C_tests" at test/c_tests.jl:1 02:39:40 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 1.81 K allocs (94.560 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:40 | maxrss 2.2% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 02:39:40 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.06 K allocs (173.000 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:42 | maxrss 2.2% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 02:39:42 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (172.360 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:42 | maxrss 2.2% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 02:39:42 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (180.072 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:39:43 | maxrss 2.2% | mem 2.2% | START (1/2) test item "bar" at src/bar_tests.jl:1 02:39:43 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (171.816 KB) 02:39:43 | maxrss 2.2% | mem 2.2% | START (2/2) test item "foo" at src/foo_test.jl:1 02:39:43 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 1.66 K allocs (82.624 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:44 | maxrss 2.2% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 02:39:44 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (171.816 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 19 02:39:45 | maxrss 2.2% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.81 K allocs (127.368 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (61.968 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (61.232 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (171.816 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (82.240 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 19 02:39:45 | maxrss 2.2% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.81 K allocs (127.368 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (61.424 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.608 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (174.928 KB) 02:39:45 | maxrss 2.2% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 02:39:45 | maxrss 2.2% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (83.872 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:138 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:39:47 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:47 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (61.408 KB) 02:39:47 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:47 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:39:47 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:47 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 2 tests on pid 19 02:39:49 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:49 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:39:49 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:49 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.96 seconds. [ Info: Scheduling 2 tests on pid 19 02:39:50 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:50 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (64.536 KB) 02:39:50 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:51 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:51 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:51 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:51 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:51 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (63.016 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.23 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:53 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:53 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:39:53 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:53 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:39:53 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:53 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (61.472 KB) 02:39:53 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:53 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:54 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:54 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scheduling 1 tests on pid 19 02:39:56 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:56 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:39:58 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (61.680 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:39:58 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:39:58 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:39:58 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:39:58 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:39:58 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (61.760 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 3 tests on pid 19 02:40:05 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:40:05 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:40:05 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:40:05 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:40:05 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:05 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:40:05 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:40:05 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:40:05 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:05 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:40:06 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:06 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (63.464 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 19 02:40:06 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:06 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:40:06 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:40:06 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:40:06 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:40:06 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (61.936 KB) 02:40:06 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:06 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.05 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.15 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scheduling 3 tests on pid 19 02:40:16 | maxrss 2.2% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 02:40:16 | maxrss 2.2% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 02:40:16 | maxrss 2.2% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 02:40:16 | maxrss 2.2% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.848 KB) 02:40:16 | maxrss 2.2% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 02:40:16 | maxrss 2.2% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) [ Tests Completed: 3/3 test items were run. 02:40:16 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 02:40:16 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 6.72 K allocs (274.136 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:597 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 222: [ Info: Starting test worker 1 on pid = 222, with 2 threads\n[ Info: Starting running test items\n Worker 222: 02:40:32 | maxrss 2.2% | mem 3.0% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 222: 02:40:35 | maxrss 2.2% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 2.7 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2375 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2358\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2334\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935\n [9] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [10] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1447\n [11] redirect_stdio\n @ ./stream.jl:1410 [inlined]\n [12] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124\n [13] macro expansion\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined]\n [14] macro expansion\n @ ./lock.jl:376 [inlined]\n [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947\n [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078\n [17] top-level scope\n @ none:1\n [18] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [19] execute\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined]\n [20] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348\n\n Worker 222: 02:40:37 | maxrss 2.2% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 222: 02:40:37 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2375 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2358\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2334\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935\n [9] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [10] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1447\n [11] redirect_stdio\n @ ./stream.jl:1410 [inlined]\n [12] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124\n [13] macro expansion\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined]\n [14] macro expansion\n @ ./lock.jl:376 [inlined]\n [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947\n [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078\n [17] top-level scope\n @ none:1\n [18] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [19] execute\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined]\n [20] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=222).\n Worker 222: [222] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:585 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:597 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:603 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 222: [ Info: Starting test worker 1 on pid = 222, with 2 threads\n[ Info: Starting running test items\n Worker 222: 02:40:32 | maxrss 2.2% | mem 3.0% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 222: 02:40:35 | maxrss 2.2% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 2.7 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2375 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2358\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2334\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935\n [9] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [10] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1447\n [11] redirect_stdio\n @ ./stream.jl:1410 [inlined]\n [12] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124\n [13] macro expansion\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined]\n [14] macro expansion\n @ ./lock.jl:376 [inlined]\n [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947\n [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078\n [17] top-level scope\n @ none:1\n [18] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [19] execute\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined]\n [20] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348\n\n Worker 222: 02:40:37 | maxrss 2.2% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 222: 02:40:37 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2375 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2358\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2334\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935\n [9] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined]\n [10] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1447\n [11] redirect_stdio\n @ ./stream.jl:1410 [inlined]\n [12] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124\n [13] macro expansion\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined]\n [14] macro expansion\n @ ./lock.jl:376 [inlined]\n [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947\n [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078\n [17] top-level scope\n @ none:1\n [18] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [19] execute\n @ ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined]\n [20] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=222).\n Worker 222: [222] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:585 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:603 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 243: [ Info: Starting test worker 1 on pid = 243, with 2 threads [ Info: Starting running test items Worker 243: 02:41:24 | maxrss 2.3% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 243: 02:41:25 | maxrss 2.3% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.4% compile), 7.74 K allocs (404.496 KB) Worker 243: [243] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 243 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 243 ┌ Error: Worker(pid=243, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 250: [ Info: Starting test worker on pid = 250, with 2 threads Worker 250: 02:41:39 | maxrss 2.3% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 250: 02:41:40 | maxrss 2.3% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (96.0% compile), 7.74 K allocs (404.496 KB) Worker 250: [250] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x71118a4a4f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 250 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 250 ┌ Error: Worker(pid=250, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 257: [ Info: Starting test worker on pid = 257, with 2 threads Worker 257: 02:41:53 | maxrss 2.3% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 257: 02:41:54 | maxrss 2.3% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.6% compile), 7.74 K allocs (404.496 KB) Worker 257: [257] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 257 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 257 ┌ Error: Worker(pid=257, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 264: [ Info: Starting test worker on pid = 264, with 2 threads Worker 264: 02:42:06 | maxrss 2.3% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 264 [264] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7c56ab4b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x7c56ab4b41c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7c56ab53485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7c56ab4b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#398 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] _trywait at ./asyncevent.jl:185 profile_printing_listener at ./Base.jl:331 #start_profile_listener##0 at ./Base.jl:351 jfptr_YY.start_profile_listenerYY.YY.0_48888.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) ┌ Error: Worker(pid=264, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 271: [ Info: Starting test worker on pid = 271, with 2 threads Worker 271: 02:42:20 | maxrss 2.3% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 271 [271] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7cc0c062df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x7cc0c06311c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7cc0c06b185b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7cc0c062df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#398 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] _trywait at ./asyncevent.jl:185 profile_printing_listener at ./Base.jl:331 #start_profile_listener##0 at ./Base.jl:351 jfptr_YY.start_profile_listenerYY.YY.0_48888.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) int64hash at /source/src/support/hashing.c:31 bitmix at /source/src/support/hashing.h:31 [inlined] hash_svec at /source/src/builtins.c:342 jl_object_id__cold at /source/src/builtins.c:475 ijl_object_id_ at /source/src/builtins.c:502 [inlined] jl_table_peek_bp at /source/src/iddict.c:118 [inlined] ijl_eqtable_get at /source/src/iddict.c:157 lookup_leafcache at /source/src/gf.c:1487 [inlined] jl_lookup_generic_ at /source/src/gf.c:4134 [inlined] ijl_apply_generic at /source/src/gf.c:4201 compileable_specialization at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:801 resolve_todo at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:868 #handle_const_prop_result!#199 at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1430 handle_const_prop_result! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1423 [inlined] #handle_any_const_result!#193 at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1306 handle_any_const_result! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1297 [inlined] compute_inlining_cases at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1369 handle_call! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1401 [inlined] assemble_inline_todo! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1652 ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:76 [inlined] run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1013 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1027 [inlined] optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1002 jfptr_optimize_121146.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:202 jfptr_finish_nocycle_121261.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4502 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1259 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1442 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1451 jfptr_typeinf_ext_toplevel_117613.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3508 _jl_invoke at /source/src/gf.c:3997 [inlined] ijl_apply_generic at /source/src/gf.c:4205 show_exception_stack at ./errorshow.jl:1013 #sprint#437 at ./strings/io.jl:115 unknown function (ip: 0x7cc092f3b4cd) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 sprint at ./strings/io.jl:110 unknown function (ip: 0x7cc092f3b22d) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_f_invokelatest at /source/src/builtins.c:875 _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_f__apply_iterate at /source/src/builtins.c:862 invokelatest at ./Base_compiler.jl:250 _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 Error at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:234 do_test at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:710 jfptr_do_test_3061.1 at /opt/julia/share/julia/compiled/v1.12/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_eval_module_expr at /source/src/toplevel.c:197 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:814 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 #73 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 #71 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 #redirect_stdio#648 at ./stream.jl:1447 redirect_stdio at ./stream.jl:1410 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] #open#330 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] #runtestitem#66 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 unknown function (ip: 0x7cc092f23582) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348 unknown function (ip: 0x7cc092f0e9ed) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#398 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] wait_readnb at ./stream.jl:416 eof at ./stream.jl:106 [inlined] read at ./stream.jl:1011 deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:851 [inlined] deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:838 serve_requests at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:340 startworker at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:310 unknown function (ip: 0x7cc092f03eff) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_toplevel_eval_flex at /source/src/toplevel.c:975 jl_toplevel_eval_flex at /source/src/toplevel.c:975 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 exec_options at ./client.jl:287 _start at ./client.jl:554 jfptr__start_94127.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] true_main at /source/src/jlapi.c:971 jl_repl_entrypoint at /source/src/jlapi.c:1139 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7cc0c05cf249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) Allocations: 3776631 (Pool: 3776562; Big: 69); GC: 5 ┌ Error: Worker(pid=271, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 278: [ Info: Starting test worker on pid = 278, with 2 threads Worker 278: 02:42:34 | maxrss 2.3% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 278 [278] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7bf93ec38f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x7bf93ec3c1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7bf93ecbc85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7bf93ec38f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#398 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] _trywait at ./asyncevent.jl:185 profile_printing_listener at ./Base.jl:331 #start_profile_listener##0 at ./Base.jl:351 jfptr_YY.start_profile_listenerYY.YY.0_48888.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) IncrementalCompact at ./../usr/share/julia/Compiler/src/ssair/ir.jl:798 jfptr_IncrementalCompact_73908.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_invoke at /source/src/gf.c:4012 tojlinvoke122859.1 at /opt/julia/lib/julia/sys.so (unknown line) j_IncrementalCompact_118642.1 at /opt/julia/lib/julia/sys.so (unknown line) ir_inline_item! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:375 batch_inline! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:663 ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:79 [inlined] run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1013 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1027 [inlined] optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1002 jfptr_optimize_121146.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:202 jfptr_finish_nocycle_121261.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4502 const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1348 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:898 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:178 infercalls at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:252 abstract_call_gf_by_type at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:338 abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2782 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2889 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2882 [inlined] abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3042 abstract_eval_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3060 [inlined] abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3389 abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3830 [inlined] abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3787 [inlined] typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4337 jfptr_typeinf_local_121027.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4495 const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1348 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:898 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:178 infercalls at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:252 abstract_call_gf_by_type at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:338 abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2782 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2889 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2882 [inlined] abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3042 abstract_eval_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3060 [inlined] abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3389 abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3830 [inlined] abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3787 [inlined] typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4337 jfptr_typeinf_local_121027.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4495 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1259 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1442 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1451 jfptr_typeinf_ext_toplevel_117613.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3508 _jl_invoke at /source/src/gf.c:3997 [inlined] ijl_apply_generic at /source/src/gf.c:4205 show_exception_stack at ./errorshow.jl:1013 #sprint#437 at ./strings/io.jl:115 unknown function (ip: 0x7bf91933b4ed) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 sprint at ./strings/io.jl:110 unknown function (ip: 0x7bf91933b24d) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_f_invokelatest at /source/src/builtins.c:875 _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] jl_f__apply_iterate at /source/src/builtins.c:862 invokelatest at ./Base_compiler.jl:250 _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 Error at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:234 do_test at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:710 jfptr_do_test_3061.1 at /opt/julia/share/julia/compiled/v1.12/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_eval_module_expr at /source/src/toplevel.c:197 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:814 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 #73 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 #71 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 #redirect_stdio#648 at ./stream.jl:1447 redirect_stdio at ./stream.jl:1410 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] #open#330 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] #runtestitem#66 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 unknown function (ip: 0x7bf919332912) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:348 unknown function (ip: 0x7bf91930eefd) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1187 wait at ./task.jl:1199 #wait#398 at ./condition.jl:141 wait at ./condition.jl:136 [inlined] wait_readnb at ./stream.jl:416 eof at ./stream.jl:106 [inlined] read at ./stream.jl:1011 deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:851 [inlined] deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:838 serve_requests at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:340 startworker at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/workers.jl:310 unknown function (ip: 0x7bf91930482f) at (unknown file) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:693 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_toplevel_eval_flex at /source/src/toplevel.c:975 jl_toplevel_eval_flex at /source/src/toplevel.c:975 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 exec_options at ./client.jl:287 _start at ./client.jl:554 jfptr__start_94127.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4005 [inlined] ijl_apply_generic at /source/src/gf.c:4205 jl_apply at /source/src/julia.h:2381 [inlined] true_main at /source/src/jlapi.c:971 jl_repl_entrypoint at /source/src/jlapi.c:1139 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7bf93ebda249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) Allocations: 3776645 (Pool: 3776576; Big: 69); GC: 5 ┌ Error: Worker(pid=278, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 285: [ Info: Starting test worker on pid = 285, with 2 threads Worker 285: 02:42:47 | maxrss 2.3% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 285: 02:42:48 | maxrss 2.3% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.1% compile), 7.63 K allocs (399.840 KB) Worker 285: [285] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7fe8a3bfef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 285 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 285 ┌ Error: Worker(pid=285, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 292: [ Info: Starting test worker on pid = 292, with 2 threads Worker 292: 02:43:01 | maxrss 2.3% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 292: 02:43:02 | maxrss 2.3% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.4% compile), 7.63 K allocs (399.840 KB) Worker 292: [292] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 292 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 292 ┌ Error: Worker(pid=292, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 299: [ Info: Starting test worker on pid = 299, with 2 threads Worker 299: 02:43:15 | maxrss 2.3% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 299: 02:43:16 | maxrss 2.3% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.5% compile), 7.63 K allocs (399.840 KB) Worker 299: [299] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 299 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 299 ┌ Error: Worker(pid=299, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 306: [ Info: Starting test worker on pid = 306, with 2 threads Worker 306: 02:43:29 | maxrss 2.3% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 306: 02:43:30 | maxrss 2.3% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.5% compile), 7.63 K allocs (399.840 KB) Worker 306: [306] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7138c9ae9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 306 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 306 ┌ Error: Worker(pid=306, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 313: [ Info: Starting test worker on pid = 313, with 2 threads Worker 313: 02:43:43 | maxrss 2.3% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 313: 02:43:44 | maxrss 2.3% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.7% compile), 7.63 K allocs (399.840 KB) Worker 313: [313] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 313 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 313 ┌ Error: Worker(pid=313, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 320: [ Info: Starting test worker on pid = 320, with 2 threads Worker 320: 02:43:56 | maxrss 2.3% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 320: 02:43:57 | maxrss 2.3% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.2% compile), 7.63 K allocs (399.840 KB) Worker 320: [320] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 320 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 320 ┌ Error: Worker(pid=320, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 327: [ Info: Starting test worker on pid = 327, with 2 threads Worker 327: 02:44:10 | maxrss 2.3% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 327: 02:44:11 | maxrss 2.3% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.2% compile), 7.63 K allocs (399.840 KB) Worker 327: [327] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 327 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 327 ┌ Error: Worker(pid=327, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 334: [ Info: Starting test worker on pid = 334, with 2 threads Worker 334: 02:44:24 | maxrss 2.3% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 334: 02:44:24 | maxrss 2.3% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.5% compile), 7.63 K allocs (399.840 KB) Worker 334: [334] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 334 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 334 ┌ Error: Worker(pid=334, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 341: [ Info: Starting test worker on pid = 341, with 2 threads Worker 341: 02:44:38 | maxrss 2.3% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 341 [341] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x736f5c300f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x736f5c3041c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x736f5c38485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x736f5c300f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=341, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 348: [ Info: Starting test worker on pid = 348, with 2 threads Worker 348: 02:44:51 | maxrss 2.3% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 348 [348] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x79a90dc48f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x79a90dc4c1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x79a90dccc85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x79a90dc48f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=348, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 355: [ Info: Starting test worker on pid = 355, with 2 threads Worker 355: 02:45:05 | maxrss 2.3% | mem 3.1% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 355 [355] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x71a57ca70f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x71a57ca741c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x71a57caf485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x71a57ca70f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=355, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 362: [ Info: Starting test worker on pid = 362, with 2 threads Worker 362: 02:45:19 | maxrss 2.3% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 362 [362] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x716209d4df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x716209d511c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x716209dd185b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x716209d4df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=362, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 369: [ Info: Starting test worker on pid = 369, with 2 threads Worker 369: 02:45:33 | maxrss 2.3% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 369: 02:45:34 | maxrss 2.3% | mem 3.0% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (97.0% compile), 153.74 K allocs (8.830 MB) Worker 369: [369] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x78feef7b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 369 ┌ Error: Worker(pid=369, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=3. Worker 376: [ Info: Starting test worker on pid = 376, with 2 threads Worker 376: 02:45:47 | maxrss 2.3% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 376: 02:45:47 | maxrss 2.3% | mem 3.0% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (96.8% compile), 153.74 K allocs (8.832 MB) Worker 376: [376] signal 15: Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 376 ┌ Error: Worker(pid=376, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=376, terminated=true, termsignal=9). [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:663 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:663 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:665 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:665 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:668 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:668 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:671 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:671 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:676 Expression: count(contains("num_runs_6"), readdir(tmpdir)) == 2 Evaluated: 3 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:676 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:681 Expression: n_passed(results) == 3 Evaluated: 0 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:681 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] DEBUG @ ReTestItems.jl:355 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/Project.toml` DEBUG @ ReTestItems.jl:364 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:390 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:829 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:392 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 383: [ Info: Starting test worker 1 on pid = 383, with 2 threads [ Info: Starting running test items Worker 383: [383] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7dba41db1f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 383 ┌ Error: Worker(pid=383, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 390: [ Info: Starting test worker on pid = 390, with 2 threads Worker 390: 02:46:19 | maxrss 2.3% | mem 3.0% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 390 [390] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl:11 unknown function (ip: 0x76a342164f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x76a3421681c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x76a3421e885b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x76a342164f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=390, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=390, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:724 | Worker 1 closed: Worker(pid=390, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:479 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:483 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:492 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:494 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:721 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:714 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:721 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:713 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1551 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1542 [3] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:714 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:723 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [9] IncludeInto @ ./Base.jl:307 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [19] _start() @ Base ./client.jl:554 DEBUG @ ReTestItems.jl:355 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/Project.toml` DEBUG @ ReTestItems.jl:364 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:390 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:801 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:829 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:392 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 397: [ Info: Starting test worker 1 on pid = 397, with 2 threads [ Info: Starting running test items Worker 397: 02:46:33 | maxrss 2.3% | mem 3.0% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 397 ┌ Error: Worker(pid=397, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 404: [ Info: Starting test worker on pid = 404, with 2 threads Worker 404: 02:46:45 | maxrss 2.3% | mem 3.0% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 404 [404] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl:11 unknown function (ip: 0x78f4a9242f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x78f4a92461c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x78f4a92c685b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x78f4a9242f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=404, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=404, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:724 | Worker 1 closed: Worker(pid=404, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:479 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:483 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:492 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:494 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:743 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:734 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:743 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:733 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1551 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1542 [3] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:745 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [9] IncludeInto @ ./Base.jl:307 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 [19] _start() @ Base ./client.jl:554 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 411: [ Info: Starting test worker 1 on pid = 411, with 2 threads [ Info: Starting running test items Worker 411: 02:47:01 | maxrss 2.3% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 411 [411] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x730109db5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x730109db91c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x730109e3985b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x730109db5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=411, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=411, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 418: [ Info: Starting test worker 1 on pid = 418, with 2 threads [ Info: Starting running test items Worker 418: 02:47:16 | maxrss 2.3% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 418 [418] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7647f809bf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x7647f809f1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7647f811f85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7647f809bf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=418, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=418, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 425: [ Info: Starting test worker 1 on pid = 425, with 2 threads [ Info: Starting running test items Worker 425: 02:47:31 | maxrss 2.3% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 425 [425] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x75ab1455df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3626 unknown function (ip: 0x75ab145611c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x75ab145e185b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x75ab1455df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=425, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=425, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 439: [ Info: Starting test worker 1 on pid = 439, with 3,2 threads [ Info: Starting running test items Worker 439: 02:48:02 | maxrss 2.3% | mem 3.0% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 439: 02:48:02 | maxrss 2.3% | mem 3.0% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (96.3% compile), 23.23 K allocs (1.319 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=439). Worker 439: [439] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:820 overwritten at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:854. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.14 seconds. [ Info: Scheduling 3 tests on pid 19 02:48:07 | maxrss 2.3% | mem 2.3% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.63 K allocs (88.008 KB) 02:48:07 | maxrss 2.3% | mem 2.3% | START (2/3) test item "other A" at test/integrationtests.jl:846 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.29 K allocs (75.248 KB) 02:48:07 | maxrss 2.3% | mem 2.3% | START (3/3) test item "other B" at test/integrationtests.jl:846 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (73.888 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 02:48:07 | maxrss 2.3% | mem 2.3% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.12 K allocs (63.088 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:48:07 | maxrss 2.3% | mem 2.3% | START (1/2) test item "other A" at test/integrationtests.jl:846 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.29 K allocs (73.888 KB) 02:48:07 | maxrss 2.3% | mem 2.3% | START (2/2) test item "other B" at test/integrationtests.jl:846 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (73.888 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 02:48:07 | maxrss 2.3% | mem 2.3% | START (1/1) test item "other B" at test/integrationtests.jl:846 02:48:07 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (73.888 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.84 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 02:48:09 | maxrss 2.3% | mem 2.3% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 02:48:09 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (60.816 KB) 02:48:09 | maxrss 2.3% | mem 2.3% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 02:48:09 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (60.816 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 449: [ Info: Starting test worker 1 on pid = 449, with 2 threads [ Info: Starting running test items Worker 449: 02:48:21 | maxrss 2.3% | mem 3.0% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 449: 02:48:21 | maxrss 2.3% | mem 3.0% | DONE (1/2) test item "same name" 0.2 secs (97.0% compile), 23.05 K allocs (1.321 MB) Worker 449: 02:48:22 | maxrss 2.3% | mem 3.0% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 449: 02:48:22 | maxrss 2.3% | mem 3.0% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (61.104 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=449). Worker 449: [449] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 456: [ Info: Starting test worker 1 on pid = 456, with 2 threads [ Info: Starting running test items Worker 456: [456] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x704c0c03ff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 456 ┌ Error: Worker(pid=456, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 Worker 463: [ Info: Starting test worker on pid = 463, with 2 threads Worker 463: [463] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x73b5f99d0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 463 ┌ Error: Worker(pid=463, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686 [ Info: All tests on worker 1 completed. Closing Worker(pid=463, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:54:01 | maxrss 2.3% | mem 2.3% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.62 K allocs (117.888 KB) 02:54:01 | maxrss 2.3% | mem 2.3% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (98.752 KB) 02:54:01 | maxrss 2.3% | mem 2.3% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (98.752 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 02:54:01 | maxrss 2.3% | mem 2.3% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 1.68 K allocs (82.592 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 19 Error in testset "happy 1" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 02:54:01 | maxrss 2.3% | mem 2.3% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.67 K allocs (86.952 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 19 Error in testset "happy 2" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 02:54:01 | maxrss 2.3% | mem 2.3% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 02:54:01 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.67 K allocs (82.208 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 19 Error in testset "happy 3" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 636: [ Info: Starting test worker 1 on pid = 636, with 2 threads [ Info: Starting running test items Worker 636: 02:54:13 | maxrss 2.3% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 636: 02:54:14 | maxrss 2.3% | mem 3.0% | DONE (1/3) test item "happy 1" 0.2 secs (95.5% compile), 23.66 K allocs (1.333 MB) Worker 636: 02:54:15 | maxrss 2.3% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 636: 02:54:15 | maxrss 2.3% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.15 K allocs (99.040 KB) Worker 636: 02:54:16 | maxrss 2.3% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 636: 02:54:16 | maxrss 2.3% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.15 K allocs (100.432 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=636). Worker 636: [636] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 643: [ Info: Starting test worker 1 on pid = 643, with 2 threads [ Info: Starting running test items Worker 643: 02:54:30 | maxrss 2.3% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 643: 02:54:30 | maxrss 2.3% | mem 3.0% | DONE (1/3) test item "happy 1" 0.2 secs (96.0% compile), 23.19 K allocs (1.317 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 643 Error in testset "happy 1" on worker 643: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 643: 02:54:32 | maxrss 2.3% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 643: 02:54:32 | maxrss 2.3% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.67 K allocs (82.496 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 643 Error in testset "happy 2" on worker 643: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 643: 02:54:33 | maxrss 2.3% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 643: 02:54:33 | maxrss 2.3% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.67 K allocs (83.888 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 643 Error in testset "happy 3" on worker 643: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=643). Worker 643: [643] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 650: [ Info: Starting test worker 1 on pid = 650, with 2 threads Worker 654: [ Info: Starting test worker 2 on pid = 654, with 2 threads [ Info: Starting running test items Worker 654: 02:55:01 | maxrss 2.3% | mem 3.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 650: 02:55:01 | maxrss 2.3% | mem 3.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 654: 02:55:02 | maxrss 2.3% | mem 3.9% | DONE (2/3) test item "happy 2" 0.5 secs (95.6% compile), 23.66 K allocs (1.333 MB) Worker 650: 02:55:02 | maxrss 2.3% | mem 3.9% | DONE (1/3) test item "happy 1" 0.5 secs (96.2% compile), 23.66 K allocs (1.333 MB) Worker 654: 02:55:06 | maxrss 2.3% | mem 3.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 654: 02:55:06 | maxrss 2.3% | mem 3.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.15 K allocs (99.072 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=650). [ Info: All tests on worker 2 completed. Closing Worker(pid=654). Worker 654: [654] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 664: [ Info: Starting test worker 1 on pid = 664, with 2 threads Worker 666: [ Info: Starting test worker 2 on pid = 666, with 2 threads [ Info: Starting running test items Worker 664: 02:55:35 | maxrss 2.3% | mem 3.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 666: 02:55:35 | maxrss 2.3% | mem 3.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 664: 02:55:36 | maxrss 2.3% | mem 3.8% | DONE (1/3) test item "happy 1" 0.5 secs (93.3% compile), 23.19 K allocs (1.317 MB) Worker 666: 02:55:37 | maxrss 2.3% | mem 3.8% | DONE (2/3) test item "happy 2" 0.5 secs (97.1% compile), 23.19 K allocs (1.317 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 666 Error in testset "happy 2" on worker 666: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 664 Error in testset "happy 1" on worker 664: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 666: 02:55:41 | maxrss 2.3% | mem 3.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 666: 02:55:41 | maxrss 2.3% | mem 3.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.67 K allocs (82.496 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=664). Worker 664: [664] signal 15: Terminated No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 666 Error in testset "happy 3" on worker 666: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=666). Worker 666: [666] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 678: [ Info: Starting test worker 1 on pid = 678, with 2 threads [ Info: Starting running test items Worker 678: 02:55:57 | maxrss 2.3% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 678: 02:55:58 | maxrss 2.3% | mem 3.0% | DONE (1/3) test item "happy 1" 0.2 secs (96.5% compile), 23.72 K allocs (1.347 MB) Worker 678: 02:55:59 | maxrss 2.3% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 678: 02:55:59 | maxrss 2.3% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.57 K allocs (78.928 KB) Worker 678: 02:56:00 | maxrss 2.3% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 678: 02:56:00 | maxrss 2.3% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.57 K allocs (80.320 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=678). Worker 678: [678] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1088 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 16.8s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1088 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 685: [ Info: Starting test worker 1 on pid = 685, with 2 threads [ Info: Starting running test items Worker 685: 02:56:15 | maxrss 2.3% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 685: 02:56:16 | maxrss 2.3% | mem 3.0% | DONE (1/3) test item "happy 1" 0.4 secs (96.3% compile), 66.43 K allocs (3.889 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 685 Error in testset "post-testitem" on worker 685: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1099 Expression: false Worker 685: 02:56:18 | maxrss 2.3% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 685: 02:56:18 | maxrss 2.3% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.19 K allocs (135.336 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 685 Error in testset "post-testitem" on worker 685: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1099 Expression: false Worker 685: 02:56:20 | maxrss 2.3% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 685: 02:56:20 | maxrss 2.3% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.19 K allocs (136.664 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 685 Error in testset "post-testitem" on worker 685: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1099 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=685). Worker 685: [685] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1110 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 20.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1110 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1117 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 20.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1117 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Activating project at `~/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1211 [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 692: [ Info: Starting test worker 1 on pid = 692, with 2 threads [ Info: Starting running test items Worker 692: 02:56:35 | maxrss 2.3% | mem 3.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 692: 02:56:36 | maxrss 2.3% | mem 3.0% | DONE (1/2) test item "correct usage" 0.4 secs (97.9% compile), 75.83 K allocs (4.329 MB) Worker 692: 02:56:37 | maxrss 2.3% | mem 3.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 692: 02:56:37 | maxrss 2.3% | mem 3.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (78.9% compile), 2.49 K allocs (137.776 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=692). Worker 692: [692] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 699: [ Info: Starting test worker 1 on pid = 699, with 2 threads [ Info: Starting running test items Worker 699: 02:56:52 | maxrss 2.3% | mem 3.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 699: 02:56:53 | maxrss 2.3% | mem 3.0% | DONE (1/2) test item "correct usage" 0.7 secs (97.7% compile), 277.70 K allocs (15.874 MB) Worker 699: 02:56:55 | maxrss 2.3% | mem 3.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 699: 02:56:55 | maxrss 2.3% | mem 3.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (53.6% compile), 5.12 K allocs (235.048 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 699 Error in testset "no pins left at end of test" on worker 699: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1143 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=699). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 19 02:56:57 | maxrss 2.3% | mem 2.3% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (1/9) test item "do_thing Pass" 0.3 secs (97.3% compile, 84.8% recompile), 94.08 K allocs (5.341 MB) 02:56:57 | maxrss 2.3% | mem 2.3% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.18 K allocs (106.832 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 19 [ Info: RUNNING Error in testset "do_thing Fail" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.13288437895732563, 0.8362405291160685, 0.8509750602352231] == 1 02:56:57 | maxrss 2.3% | mem 2.3% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (3/9) test item "do_thing Error" <0.1 secs (<0.1% compile), 52.45 K allocs (7.363 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 19 [ Info: RUNNING Error in testset "do_thing Error" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 02:56:57 | maxrss 2.3% | mem 2.3% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (4/9) test item "bad setup, good test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 19 Error in testset "bad setup, good test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [25] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [26] #508 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1165 [inlined] [27] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [28] activate(f::var"#with_test_package##4#with_test_package##5"{var"#508#509"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [29] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [30] cd(f::var"#with_test_package##2#with_test_package##3"{var"#508#509"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [31] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [34] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#508#509"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [35] with_test_package(f::var"#508#509"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [36] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1156 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1159 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1164 [inlined] [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [44] IncludeInto @ ./Base.jl:307 [inlined] [45] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [46] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [49] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [51] top-level scope @ none:6 [52] eval(m::Module, e::Any) @ Core ./boot.jl:489 [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:56:57 | maxrss 2.3% | mem 2.3% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 19 Error in testset "bad setup, bad test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [9] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:973 [inlined] [10] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [11] redirect_stdio @ ./stream.jl:1410 [inlined] [12] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:972 [inlined] [14] macro expansion @ ./lock.jl:376 [inlined] [15] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:947 [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1078 [17] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [24] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [25] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [26] #508 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1165 [inlined] [27] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [28] activate(f::var"#with_test_package##4#with_test_package##5"{var"#508#509"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [29] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [30] cd(f::var"#with_test_package##2#with_test_package##3"{var"#508#509"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [31] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [34] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#508#509"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [35] with_test_package(f::var"#508#509"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [36] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1156 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1159 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1164 [inlined] [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [44] IncludeInto @ ./Base.jl:307 [inlined] [45] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [46] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [49] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [51] top-level scope @ none:6 [52] eval(m::Module, e::Any) @ Core ./boot.jl:489 [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:56:57 | maxrss 2.3% | mem 2.3% | START (6/9) test item "errors" at test/error_tests.jl:1 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (6/9) test item "errors" <0.1 secs (<0.1% compile), 27.56 K allocs (2.093 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 19 [ Info: RUNNING Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#906"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#906"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2375 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2358 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2334 [5] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [10] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [11] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [12] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [13] redirect_stdio @ ./stream.jl:1410 [inlined] [14] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [15] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [16] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [17] open @ ./io.jl:407 [inlined] [18] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [19] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [20] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [21] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [22] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [23] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [24] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [25] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [26] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [27] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [28] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [29] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [30] #508 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1165 [inlined] [31] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [32] activate(f::var"#with_test_package##4#with_test_package##5"{var"#508#509"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [33] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [34] cd(f::var"#with_test_package##2#with_test_package##3"{var"#508#509"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [35] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#508#509"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [39] with_test_package(f::var"#508#509"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [40] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1156 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1159 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1164 [inlined] [47] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [48] IncludeInto @ ./Base.jl:307 [inlined] [49] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [50] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [51] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [52] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [53] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [54] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [55] top-level scope @ none:6 [56] eval(m::Module, e::Any) @ Core ./boot.jl:489 [57] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:56:57 | maxrss 2.3% | mem 2.3% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (7/9) test item "errors at the top level" <0.1 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 19 [ Info: RUNNING Error in testset "errors at the top level" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [23] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [24] #508 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1165 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#508#509"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#508#509"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#508#509"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#508#509"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [34] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1156 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1159 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1164 [inlined] [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [42] IncludeInto @ ./Base.jl:307 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:56:57 | maxrss 2.3% | mem 2.3% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (8/9) test item "nonexistent test setup" <0.1 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 19 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #73 @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [inlined] [4] with_source_path(f::ReTestItems.var"#73#74"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:935 [5] (::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1112 [6] redirect_stdio(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1447 [7] redirect_stdio @ ./stream.jl:1410 [inlined] [8] _redirect_logs(f::ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#71#72"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1109 [15] runtestitem @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:1031 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:418 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:375 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:358 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:328 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [23] runtests @ ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:251 [inlined] [24] #508 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1165 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#508#509"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1388 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#508#509"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#508#509"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#508#509"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:31 [34] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1156 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1159 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1164 [inlined] [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [42] IncludeInto @ ./Base.jl:307 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:306 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:287 02:56:57 | maxrss 2.3% | mem 2.3% | START (9/9) test item "failures" at test/failure_tests.jl:1 02:56:57 | maxrss 2.3% | mem 2.3% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.36 K allocs (154.864 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 19 [ Info: RUNNING Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.5072045220336149 < 0 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 0.6s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.3s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.1s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.0s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 0.1s UndefVarError | 2 2 0.0s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.0s errors at the top level | 1 1 2 0.0s nonexistent test setup | 1 1 0.0s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1184. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1184 overwritten at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1215. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 769: [ Info: Starting test worker 1 on pid = 769, with 2 threads [ Info: Starting running test items Worker 769: 02:59:18 | maxrss 2.4% | mem 3.1% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 769: 02:59:18 | maxrss 2.4% | mem 3.1% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (96.8% compile), 23.05 K allocs (1.321 MB) Worker 769: 02:59:19 | maxrss 2.4% | mem 3.1% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 769: 02:59:19 | maxrss 2.4% | mem 3.1% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.45 K allocs (75.744 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 769 Error in testset "skip false, 1 pass, 1 fail" on worker 769: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_skip_tests.jl:8 Expression: false Worker 769: 02:59:20 | maxrss 2.4% | mem 3.1% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 769: 02:59:22 | maxrss 2.4% | mem 3.1% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 769: 02:59:22 | maxrss 2.4% | mem 3.1% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.45 K allocs (77.056 KB) Worker 769: 02:59:23 | maxrss 2.4% | mem 3.1% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 769: 02:59:24 | maxrss 2.4% | mem 3.1% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=769). Worker 769: [769] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1231 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 21.0s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1231 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_parse_error_test.jl 02:59:36 | maxrss 2.4% | mem 3.0% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_direct_testitem.jl:6 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Test Summary: | Fail Total Time should fail | 1 1 5.7s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 839: [ Info: Starting test worker 3 on pid = 839, with 2 threads\n Worker 836: [ Info: Starting test worker 1 on pid = 836, with 2 threads\n Worker 838: [ Info: Starting test worker 2 on pid = 838, with 2 threads\n[ Info: Starting running test items\n Worker 836: [836] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x737cd9079f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 839: [839] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x79a291f88f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 838: [838] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x75fd4c748f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 838\n┌ Error: Worker(pid=838, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 839\n┌ Error: Worker(pid=839, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 836\n┌ Error: Worker(pid=836, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 861: [ Info: Starting test worker on pid = 861, with 2 threads\n Worker 857: [ Info: Starting test worker on pid = 857, with 2 threads\n Worker 859: [ Info: Starting test worker on pid = 859, with 2 threads\n Worker 861: [861] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7491b9ce3f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 857: [857] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7aaa72cc8f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 859: [859] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x786d10061f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 861\n┌ Error: Worker(pid=861, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=861, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 857\n┌ Error: Worker(pid=857, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 2 completed. Closing Worker(pid=857, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 859\n┌ Error: Worker(pid=859, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 3 completed. Closing Worker(pid=859, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 892: [ Info: Starting test worker 1 on pid = 892, with 2 threads\n Worker 895: [ Info: Starting test worker 3 on pid = 895, with 2 threads\n Worker 894: [ Info: Starting test worker 2 on pid = 894, with 2 threads\n[ Info: Starting running test items\n Worker 895: [895] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c131a1e4f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 892: [892] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x70f03b9e6f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 894: [894] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x771d11b56f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\n\nNo Captured LogsNo Captured Logs for test item \"may not run\" at for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:9test/testfiles/_failfast_timeout_tests.jl:1 on worker 895\n┌ Error: Worker(pid=895, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n on worker 892[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\n┌ Error: Worker(pid=892, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 894\n┌ Error: Worker(pid=894, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 914: [ Info: Starting test worker on pid = 914, with 2 threads\n Worker 913: [ Info: Starting test worker on pid = 913, with 2 threads\n Worker 915: [ Info: Starting test worker on pid = 915, with 2 threads\n Worker 914: [914] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c91199a4f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 913: [913] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7169f0196f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 915: [915] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7dfce5786f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 914\n┌ Error: Worker(pid=914, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=914, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 913\n┌ Error: Worker(pid=913, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 3 completed. Closing Worker(pid=913, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 915\n┌ Error: Worker(pid=915, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 2 completed. Closing Worker(pid=915, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1325 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 948: [ Info: Starting test worker 1 on pid = 948, with 2 threads\n Worker 950: [ Info: Starting test worker 2 on pid = 950, with 2 threads\n Worker 951: [ Info: Starting test worker 3 on pid = 951, with 2 threads\n[ Info: Starting running test items\n Worker 950: [950] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x772d25e9cf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 951: [951] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c4fca973f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 948: [948] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x77e8a31e3f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 951\n┌ Error: Worker(pid=951, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\n\nNo Captured LogsNo Captured Logs for test item \"good\" at for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:1test/testfiles/_failfast_crash_tests.jl:4 on worker 948\n┌ Error: Worker(pid=948, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n on worker 950[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\n┌ Error: Worker(pid=950, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 969: [ Info: Starting test worker on pid = 969, with 2 threads\n Worker 973: [ Info: Starting test worker on pid = 973, with 2 threads\n Worker 971: [ Info: Starting test worker on pid = 971, with 2 threads\n Worker 971: [971] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f4b9f699f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 973: [973] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x710063726f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 969: [969] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c4b10ba3f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 971\n┌ Error: Worker(pid=971, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=971, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 973\n┌ Error: Worker(pid=973, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 2 completed. Closing Worker(pid=973, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 969\n┌ Error: Worker(pid=969, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/3F3Hj/src/ReTestItems.jl:686\n[ Info: All tests on worker 3 completed. Closing Worker(pid=969, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1298 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1300 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1312 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/3F3Hj/test/integrationtests.jl:1334 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 19 03:06:16 | maxrss 2.4% | mem 2.4% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 03:06:16 | maxrss 2.4% | mem 2.4% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 19 Error in testset "test set" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 19 03:06:18 | maxrss 2.4% | mem 2.4% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 03:06:18 | maxrss 2.4% | mem 2.4% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 19 Error in testset "Failure at toplevel" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 03:06:18 | maxrss 2.4% | mem 2.4% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 03:06:19 | maxrss 2.4% | mem 2.4% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 19 Error in testset "Bar" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. 03:07:30 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 03:07:30 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" 0.1 secs (98.9% compile), 78.00 K allocs (4.798 MB) 03:07:31 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 03:07:31 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" <0.1 secs (24.5% compile, 70.3% GC), 1.81 K allocs (247.248 KB) 03:07:31 | maxrss 2.4% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 03:07:31 | maxrss 2.4% | mem 3.1% | DONE test item "uses printstyled" 0.4 secs (99.5% compile), 386.18 K allocs (22.943 MB) 03:07:32 | maxrss 2.4% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 03:07:32 | maxrss 2.4% | mem 3.1% | DONE test item "uses @error" 0.2 secs (97.4% compile), 30.94 K allocs (1.943 MB) 03:07:32 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 03:07:32 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @info" 0.3 secs (97.2% compile), 38.25 K allocs (2.261 MB) 03:07:33 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 03:07:33 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (78.8% compile), 9.86 K allocs (610.024 KB) 03:07:33 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 03:07:33 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stdout" 0.2 secs (95.5% compile), 40.40 K allocs (2.505 MB) 03:07:33 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 03:07:34 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (96.1% compile), 38.65 K allocs (2.456 MB) 03:07:34 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 03:07:34 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (95.5% compile), 73.56 K allocs (4.464 MB) 03:07:34 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 03:07:34 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (91.2% compile), 14.74 K allocs (1.023 MB) 03:07:35 | maxrss 2.4% | mem 3.2% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 03:07:35 | maxrss 2.4% | mem 3.2% | DONE test item "uses display" 0.5 secs (99.4% compile, 11.8% GC), 257.08 K allocs (14.709 MB) 03:07:36 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:184 03:07:36 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 785 allocs (52.672 KB) 03:07:37 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:199 03:07:37 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 785 allocs (52.672 KB) 03:07:37 | maxrss 2.4% | mem 3.2% | START test item "setup uses printstyled" at _test_log_capture.jl:214 03:07:37 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses printstyled" <0.1 secs, 787 allocs (53.408 KB) 03:07:37 | maxrss 2.4% | mem 3.2% | START test item "setup uses @error" at _test_log_capture.jl:229 03:07:37 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses @error" <0.1 secs, 785 allocs (52.672 KB) 03:07:37 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 03:07:37 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.39 K allocs (75.680 KB) 03:07:38 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 03:07:38 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.39 K allocs (75.680 KB) 03:07:38 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 03:07:38 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.41 K allocs (76.896 KB) 03:07:38 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger" at _test_log_capture.jl:315 03:07:38 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger" <0.1 secs, 785 allocs (52.672 KB) 03:07:39 | maxrss 2.4% | mem 3.2% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 03:07:39 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses display" <0.1 secs, 785 allocs (52.672 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 12.8s 03:07:49 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 03:07:49 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" <0.1 secs (94.2% compile), 24.25 K allocs (1.450 MB) 03:07:49 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" <0.1 secs (81.8% compile), 811 allocs (56.672 KB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses printstyled" <0.1 secs (81.9% compile), 4.36 K allocs (272.464 KB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses @error" 0.2 secs (97.0% compile), 19.10 K allocs (1.115 MB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @info" 0.3 secs (97.1% compile), 38.31 K allocs (2.264 MB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (80.4% compile), 9.90 K allocs (612.408 KB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stdout" 0.1 secs (96.3% compile), 40.44 K allocs (2.507 MB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 03:07:50 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (96.8% compile), 38.69 K allocs (2.411 MB) 03:07:50 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 03:07:51 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (96.0% compile), 73.61 K allocs (4.469 MB) 03:07:51 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 03:07:51 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (90.6% compile), 10.79 K allocs (669.000 KB) 03:07:51 | maxrss 2.4% | mem 3.1% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 03:07:52 | maxrss 2.4% | mem 3.1% | DONE test item "uses display" 1.0 secs (99.7% compile), 652.26 K allocs (37.996 MB) 03:07:52 | maxrss 2.4% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:184 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 829 allocs (55.024 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:199 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 829 allocs (55.024 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses printstyled" at _test_log_capture.jl:214 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses printstyled" <0.1 secs, 831 allocs (55.792 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses @error" at _test_log_capture.jl:229 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses @error" <0.1 secs, 829 allocs (55.024 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.43 K allocs (78.080 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.43 K allocs (78.080 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.45 K allocs (79.408 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses with_logger" at _test_log_capture.jl:315 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses with_logger" <0.1 secs, 829 allocs (55.056 KB) 03:07:53 | maxrss 2.4% | mem 3.1% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 03:07:53 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses display" <0.1 secs, 829 allocs (55.024 KB) Test Summary: | Pass Broken Total Time log capture logs=:batched |  26  2  28 7.4s 03:08:04 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 03:08:04 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" <0.1 secs (94.4% compile), 24.25 K allocs (1.450 MB) 03:08:04 | maxrss 2.4% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 03:08:04 | maxrss 2.4% | mem 3.1% | DONE test item "uses println" <0.1 secs (81.9% compile), 811 allocs (56.672 KB) 03:08:04 | maxrss 2.4% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 03:08:04 | maxrss 2.4% | mem 3.1% | DONE test item "uses printstyled" <0.1 secs (83.4% compile), 4.36 K allocs (272.464 KB) 03:08:04 | maxrss 2.4% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses @error" 0.2 secs (97.2% compile), 19.10 K allocs (1.115 MB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @info" 0.3 secs (97.1% compile), 38.31 K allocs (2.264 MB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (82.6% compile), 9.90 K allocs (612.408 KB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stdout" 0.1 secs (96.2% compile), 40.44 K allocs (2.507 MB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (96.5% compile), 38.69 K allocs (2.411 MB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 03:08:05 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.2 secs (95.9% compile), 73.61 K allocs (4.469 MB) 03:08:05 | maxrss 2.4% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 03:08:06 | maxrss 2.4% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (91.1% compile), 10.79 K allocs (668.968 KB) 03:08:06 | maxrss 2.4% | mem 3.1% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 03:08:06 | maxrss 2.4% | mem 3.1% | DONE test item "uses display" 0.9 secs (99.7% compile), 652.26 K allocs (37.996 MB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:184 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 829 allocs (55.024 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:199 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 829 allocs (55.024 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses printstyled" at _test_log_capture.jl:214 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses printstyled" <0.1 secs, 831 allocs (55.792 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses @error" at _test_log_capture.jl:229 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses @error" <0.1 secs, 829 allocs (55.024 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.43 K allocs (78.080 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.43 K allocs (78.080 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.45 K allocs (79.408 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses with_logger" at _test_log_capture.jl:315 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses with_logger" <0.1 secs, 829 allocs (55.056 KB) 03:08:07 | maxrss 2.4% | mem 3.1% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 03:08:07 | maxrss 2.4% | mem 3.1% | DONE test item "setup uses display" <0.1 secs, 829 allocs (55.024 KB) Test Summary: | Pass Broken Total Time log capture logs=:issues |  26  2  28 7.3s ┌ Warning: Skipping JUnit XML reference tests on unrelease Julia version │ VERSION = v"1.12.0-rc2.1" └ @ Main ~/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:31 Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 1719 21 2 3 1745 41m08.3s workers.jl | 40 40 1m00.7s correct connected/running states (Worker(pid=23)) | 7 7 0.1s clean shutdown (Worker(pid=23)) | 6 6 2.3s more forceful shutdown (Worker(pid=28)) | 7 7 0.4s remote_eval/remote_fetch (Worker(pid=33)) | 5 5 5.0s worker crashing (Worker(pid=38)) | 7 7 2.6s remote_eval (Worker(pid=43)) | 2 2 3.9s CPU profile | 6 6 14.9s internals.jl | 435 435 13.3s get_starting_testitems | 300 300 2.7s is_test_file | 20 20 0.0s is_testsetup_file | 5 5 0.0s _is_subproject | 7 7 0.1s include_testfiles! | 18 18 6.9s report_empty_testsets | 6 6 1.1s JUnit _error_message | 2 2 0.2s _validated_nworker_threads | 19 19 0.2s _validated_paths | 13 13 0.3s skiptestitem | 4 4 0.8s should_skip | 8 8 0.5s filtering.jl | 21 21 0.4s nestedrelpath | 12 12 0.0s macros.jl | 98 98 15.7s testsetup macro basic | 1 1 0.0s testitem macro basic | 4 4 3.1s testitem with `tags` | 3 3 0.2s testitem with `retries` | 3 3 0.2s testitem with macro import | 2 2 1.9s testitem with `setup` | 5 5 0.7s testsetup and testitem with includes | 3 3 0.2s missing testsetup | 1 1 4.1s testitem with duplicate keywords | 1 1 0.5s can identity if in a `@testitem` | 2 2 0.0s testitem macro runs immediately outside `runtests` | 6 6 1.6s manually specify `source` location | 4 4 0.0s testsetup not given module | 2 2 1.3s testitem `_id` keyword | 6 6 0.8s testitem `timeout` keyword | 8 8 0.6s testitem `skip` keyword | 34 34 0.2s tesitem `failfast` keyword | 2 2 0.1s testitem with `default_imports` | 6 6 0.2s testitem with unrecognised keyword | 1 1 0.0s testitem without a body | 4 4 0.0s integrationtests.jl | 379 21 2 3 405 38m11.9s manual `runtests(dir)` | 2 2 13.0s manual `runtests(file)` | 2 2 0.3s `runtests(path)` auto finds testsetups | 3 3 3.9s Warn or error when not test file | 11 11 3.8s filter `runtests(func, x)` | 11 11 13.3s `@testitem` scoping rules | 1 1 0.2s single-process | 14 1 15 3m21.8s Pkg.test() NoDeps.jl | 1 1 28.1s Pkg.test() TestsInSrc.jl | 1 1 25.2s Pkg.test() TestProjectFile.jl | 1 1 27.6s Pkg.test() TestEndExpr.jl | 1 1 1m00.3s Pkg.test() DontPass.jl | 1 1 36.8s runtests() NoDeps.jl | 2 2 0.2s runtests() TestsInSrc.jl | 2 2 0.1s runtests() TestProjectFile.jl | 2 2 1.1s runtests() TestEndExpr.jl | 1 1 0.0s runtests() DontPass.jl | 3 3 22.3s runtests a dir with 0 nworkers but worker_init_expr set | 2 2 0.7s runtests with nworkers = 2 | 10 10 6m07.3s Pkg.test() NoDeps.jl | 2 2 1m12.6s Pkg.test() TestsInSrc.jl | 2 2 1m20.6s Pkg.test() TestProjectFile.jl | 2 2 1m04.1s Pkg.test() TestEndExpr.jl | 2 2 49.5s Pkg.test() DontPass.jl | 2 2 1m40.4s don't recurse into subpackages | 2 2 3.6s trigger subpackage tests | 3 3 25.0s passing file (not dir) | 1 1 0.2s passing multiple files/dirs | 4 4 4.2s print report sorted | 2 2 1.1s `verbose_results`, `debug` and `logs` keywords | 48 48 1.4s `report=true` is not compatible with `logs=:eager` | 1 1 0.2s filter `runtests(x; tags)` | 8 8 5.6s filter `runtests(x; name)` | 7 7 5.8s filter `runtests(x; name, tags)` | 7 7 7.3s filter `runtests(func, x; name, tags)` | 7 7 10.0s Warn on empty test set -- integration test | 3 3 0.1s log capture for an errored TestSetup | 2 2 4 26.6s test crashing testitem | 4 4 28.9s test retrying failing testitem | 2 6 8 4m37.3s bugfix: `runtests` in a testset | 2 2 1.3s testitem_timeout | 1 1 1 3 29.5s testitem_timeout set via env variable | 1 1 1 3 26.5s @testitem `timeout` | 12 12 47.8s Error outside `@testitem` | 2 2 0.0s `runtests` finds no testitems | 2 2 0.0s Worker log capture on a failing test is not reported twice | 1 1 15.1s Worker and nworker_threads argument | 1 1 14.6s _redirect_logs and custom loggers | 1 1 0.5s error on code outside `@testitem`/`@testsetup` | 10 10 4.2s Duplicate names in same file throws | 2 2 0.1s Duplicate names in different files allowed | 2 2 15.4s Duplicate IDs not allowed | 2 2 0.1s Timeout failures accurately record elapsed time | 1 1 24.1s CPU profile timeout trigger | 16 16 3m18.9s worker always crashes immediately | 4 4 59.2s worker crashes immediately but succeeds on retry | 3 3 54.2s test_end_expr | 21 3 24 2m56.1s nworkers=0 | 5 5 0.8s nworkers=1 | 5 5 33.9s nworkers=2 | 5 5 1m09.4s report printing | 2 3 5 38.0s TestEndExpr.jl package | 4 4 34.0s test_end_expr always runs, even if testitem throws | 2 2 0.9s Replace workers when we hit memory threshold | 7 7 2m04.1s skipping testitems | 1 1 24.1s logs are aligned | 3 3 0.5s ParseError in test file | 2 2 1.5s invalid testitem combined with filter function | 24 24 0.1s error code from running `@testitem` directly | 1 1 14.8s runtests `failfast` keyword | 61 7 2 70 6m33.1s failure | 17 1 18 1m24.4s nworkers=0 | 6 6 0.5s nworkers=1 | 6 6 16.9s nworkers=3 | 5 1 6 1m06.9s error | 16 2 18 1m25.9s nworkers=0 | 6 6 0.1s nworkers=1 | 6 6 19.3s nworkers=3 | 4 2 6 1m06.5s timeout | 10 2 1 13 1m37.9s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 32.0s nworkers=3 | 4 2 6 1m05.9s crash | 10 2 1 13 1m32.7s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 26.5s nworkers=3 | 4 2 6 1m06.3s multiple failures | 5 5 31.8s ENV var | 3 3 0.5s Handle `@testset failfast=true` | 3 3 0.2s DONE time reported when testitem throws | 2 2 0.9s runtests `testitem_failfast` keyword | 27 27 3.2s `test_end_expr` must be `:block` | 1 1 0.2s throw if no test items | 4 4 1.0s bugfix: don't overcount when nworkers > ntestitems | 1 1 57.9s log_capture.jl | 52 52 1m08.7s log capture | 3 3 49.4s Workers print in color | 1 1 18.6s log capture -- reporting | 12 12 0.2s default_log_display_mode | 20 20 0.0s print_time | 16 16 0.6s tests removed workers | 714 714 0.1s RNG of the outermost testset: Random.Xoshiro(0xe1d646b76b49804a, 0xa6c34daf5748b1cc, 0xac747aeb91fa2d8a, 0x158121b1a0c4f144, 0xcaee823ab069123c) ERROR: LoadError: Some tests did not pass: 1719 passed, 21 failed, 2 errored, 3 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/3F3Hj/test/runtests.jl:13 Testing failed after 2432.4s ERROR: LoadError: Package ReTestItems errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2427 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2280 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:483 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:164 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:152 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:151 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:305 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:321 [12] _start() @ Base ./client.jl:554 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 2526.46s: package is using an unknown package