Package evaluation to test ReTestItems on Julia 1.12.4 (0f21d93eaa*) started at 2026-01-26T17:03:59.989 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.29s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [817f1d60] + ReTestItems v1.35.1 Updating `~/.julia/environments/v1.12/Manifest.toml` [817f1d60] + ReTestItems v1.35.1 [1e6cf692] + TestEnv v1.103.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.12.1 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 Installation completed after 1.13s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 981.4 ms ✓ XMLDict 1 dependency successfully precompiled in 1 seconds. 42 already precompiled. Precompilation completed after 14.47s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_ySYI6V/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v1.0.0 [817f1d60] ReTestItems v1.35.1 [1e6cf692] TestEnv v1.103.2 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.12.1 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_ySYI6V/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.3 [b5f81e59] IOCapture v1.0.0 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.1 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.5.1 [817f1d60] ReTestItems v1.35.1 [1e6cf692] TestEnv v1.103.2 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.15.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... Worker 24: [24] signal 15: Terminated Worker 29: [29] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:152 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:152 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:156 17:05:59 | maxrss 1.5% | mem 1.7% | SKIP (0/1) test item "skip" at internals.jl:296 17:06:04 | maxrss 1.6% | mem 1.8% | START test item "TI1" at macros.jl:32 17:06:04 | maxrss 1.6% | mem 1.8% | DONE test item "TI1" 0.1 secs (97.9% compile), 81.66 K allocs (4.518 MB) 17:06:05 | maxrss 1.6% | mem 1.8% | START test item "TI2" at macros.jl:43 17:06:05 | maxrss 1.6% | mem 1.8% | DONE test item "TI2" <0.1 secs (<0.1% compile), 967 allocs (54.144 KB) 17:06:05 | maxrss 1.6% | mem 1.8% | START test item "TI" at macros.jl:53 17:06:05 | maxrss 1.6% | mem 1.8% | DONE test item "TI" <0.1 secs (<0.1% compile), 967 allocs (54.176 KB) 17:06:05 | maxrss 1.6% | mem 1.8% | START test item "macro-import" at macros.jl:64 17:06:07 | maxrss 1.6% | mem 1.8% | DONE test item "macro-import" 1.5 secs (99.1% compile), 630.13 K allocs (34.525 MB) 17:06:07 | maxrss 1.6% | mem 1.8% | START test item "Foo" at macros.jl:95 17:06:07 | maxrss 1.6% | mem 1.8% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.82 K allocs (125.120 KB) 17:06:08 | maxrss 1.6% | mem 1.8% | START test item "Foo3" at macros.jl:110 17:06:08 | maxrss 1.6% | mem 1.8% | DONE test item "Foo3" <0.1 secs (<0.1% compile), 1.96 K allocs (92.672 KB) 17:06:08 | maxrss 1.6% | mem 1.8% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:109 [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [8] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [9] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [10] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1065 [11] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/macros.jl:23 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/macros.jl:118 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/macros.jl:123 [inlined] [16] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [17] IncludeInto @ ./Base.jl:308 [inlined] [18] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:20 [19] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [20] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [23] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [24] top-level scope @ none:6 [25] eval(m::Module, e::Any) @ Core ./boot.jl:489 [26] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [27] _start() @ Base ./client.jl:550 17:06:12 | maxrss 1.8% | mem 1.9% | DONE test item "Foo4" 17:06:12 | maxrss 1.8% | mem 1.9% | START test item "testitem active" at macros.jl:138 17:06:12 | maxrss 1.8% | mem 1.9% | DONE test item "testitem active" <0.1 secs (83.1% compile), 2.90 K allocs (150.224 KB) 17:06:12 | maxrss 1.8% | mem 1.9% | START test item "run" at macros.jl:146 17:06:12 | maxrss 1.8% | mem 1.9% | DONE test item "run" <0.1 secs (<0.1% compile), 966 allocs (55.616 KB) 17:06:13 | maxrss 1.8% | mem 1.9% | START test item "comparisons" at macros.jl:182 17:06:14 | maxrss 1.8% | mem 1.9% | DONE test item "comparisons" 0.1 secs (80.8% compile), 35.00 K allocs (2.004 MB) 17:06:15 | maxrss 1.8% | mem 1.9% | SKIP test item "skip isa bool" at macros.jl:306 17:06:15 | maxrss 1.8% | mem 1.9% | SKIP test item "test contains error" at macros.jl:314 17:06:16 | maxrss 1.8% | mem 1.9% | SKIP test item "skip isa expr 1" at macros.jl:335 17:06:16 | maxrss 1.8% | mem 1.9% | SKIP test item "skip isa expr 2" at macros.jl:345 17:06:16 | maxrss 1.8% | mem 1.9% | SKIP test item "skip expr loads module" at macros.jl:362 17:06:16 | maxrss 1.8% | mem 1.9% | SKIP test item "skip expr defines variable" at macros.jl:371 17:06:16 | maxrss 1.8% | mem 1.9% | SKIP test item "skip expr defines variable" at macros.jl:371 17:06:16 | maxrss 1.8% | mem 1.9% | START test item "default_imports" at macros.jl:424 17:06:16 | maxrss 1.8% | mem 1.9% | DONE test item "default_imports" <0.1 secs (<0.1% compile), 1.44 K allocs (71.616 KB) 17:06:16 | maxrss 1.8% | mem 1.9% | START test item "no_default_imports" at macros.jl:432 17:06:16 | maxrss 1.8% | mem 1.9% | DONE test item "no_default_imports" 0.2 secs (99.3% compile), 440.40 K allocs (24.935 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/rFUty` Updating `~/.julia/packages/ReTestItems/rFUty/Project.toml` [1e6cf692] + TestEnv v1.103.2 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.12.1 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/rFUty/Manifest.toml` [1e6cf692] + TestEnv v1.103.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] ~ Pkg ⇒ v1.12.1 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.64.0+1 [3f19e933] + p7zip_jll v17.7.0+0 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:06:49 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 17:06:50 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.29 K allocs (71.728 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:06:50 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 17:06:50 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.21 K allocs (65.648 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:06:50 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 17:06:50 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.21 K allocs (67.088 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` 17:06:53 | maxrss 2.1% | mem 2.1% | START (1/1) test item "foo" at src/foo_test.jl:1 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "foo" 0.9 secs (2.4% compile), 66.33 K allocs (7.921 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 17:06:54 | maxrss 2.1% | mem 2.1% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.82 K allocs (126.824 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (59.632 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (59.664 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:06:54 | maxrss 2.1% | mem 2.1% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (59.712 KB) 17:06:54 | maxrss 2.1% | mem 2.1% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:06:55 | maxrss 2.1% | mem 2.1% | DONE (7/8) test item "bar" 0.6 secs (97.7% compile), 337.57 K allocs (17.727 MB) 17:06:55 | maxrss 2.1% | mem 2.1% | START (8/8) test item "foo" at src/foo_test.jl:1 17:06:55 | maxrss 2.1% | mem 2.1% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (81.360 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scheduling 1 tests on pid 15 17:06:58 | maxrss 2.1% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:06:58 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (171.192 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.05 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 1 tests on pid 15 17:07:01 | maxrss 2.1% | mem 2.1% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 17:07:01 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.16 seconds. [ Info: Scheduling 1 tests on pid 15 17:07:03 | maxrss 2.1% | mem 2.1% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 17:07:03 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.15 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.32 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 15 17:07:09 | maxrss 2.1% | mem 2.1% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 17:07:09 | maxrss 2.1% | mem 2.1% | DONE (1/5) test item "scope test - loops" <0.1 secs (<0.1% compile), 1.38 K allocs (72.816 KB) 17:07:09 | maxrss 2.1% | mem 2.1% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 17:07:09 | maxrss 2.1% | mem 2.1% | DONE (2/5) test item "scope test - setups" <0.1 secs (<0.1% compile), 1.52 K allocs (78.864 KB) 17:07:09 | maxrss 2.1% | mem 2.1% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 17:07:09 | maxrss 2.1% | mem 2.1% | DONE (3/5) test item "scope test - testsets" <0.1 secs (<0.1% compile), 2.76 K allocs (125.240 KB) 17:07:09 | maxrss 2.1% | mem 2.1% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 17:07:09 | maxrss 2.1% | mem 2.1% | DONE (4/5) test item "scope test - imports" <0.1 secs (65.3% compile), 7.27 K allocs (336.376 KB) 17:07:09 | maxrss 2.1% | mem 2.1% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 17:07:09 | maxrss 2.1% | mem 2.1% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.69 K allocs (126.504 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl/Manifest.toml:0 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing NoDeps Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_63zC4H/Project.toml` [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_63zC4H/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.103.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.1 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.7.0+0 Test Successfully re-resolved Status `/tmp/jl_63zC4H/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [8dfed614] Test v1.11.0 Status `/tmp/jl_63zC4H/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.44 seconds. [ Info: Scheduling 2 tests on pid 64 17:07:39 | maxrss 2.1% | mem 3.2% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 17:07:39 | maxrss 2.1% | mem 3.2% | DONE (1/2) test item "toplevel" 0.2 secs (97.2% compile), 16.55 K allocs (832.944 KB) 17:07:40 | maxrss 2.1% | mem 3.2% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 17:07:40 | maxrss 2.1% | mem 3.2% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (95.6% compile), 44.60 K allocs (2.481 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 64 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.7s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.0s Testing NoDeps tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing TestsInSrc Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_yAecAG/Project.toml` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_yAecAG/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.103.2 [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.1 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.7.0+0 Test Successfully re-resolved Status `/tmp/jl_yAecAG/Project.toml` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_yAecAG/Manifest.toml` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] TestEnv v1.103.2 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.38 seconds. [ Info: Scheduling 8 tests on pid 68 17:08:06 | maxrss 2.1% | mem 3.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:08:06 | maxrss 2.1% | mem 3.2% | DONE (1/8) test item "a1" 0.2 secs (96.5% compile), 17.23 K allocs (883.752 KB) 17:08:06 | maxrss 2.1% | mem 3.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (2/8) test item "a2" 0.2 secs (94.5% compile), 44.54 K allocs (2.476 MB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.00 K allocs (56.848 KB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.00 K allocs (56.144 KB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.00 K allocs (56.208 KB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.00 K allocs (55.952 KB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (7/8) test item "bar" 0.6 secs (97.6% compile), 340.04 K allocs (17.850 MB) 17:08:07 | maxrss 2.1% | mem 3.2% | START (8/8) test item "foo" at src/foo_test.jl:1 17:08:07 | maxrss 2.1% | mem 3.2% | DONE (8/8) test item "foo" <0.1 secs (77.5% compile), 3.43 K allocs (168.768 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.3s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.0s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.6s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing TestProjectFile Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_TTtAJr/Project.toml` [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_TTtAJr/Manifest.toml` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [69de0a69] ↑ Parsers v2.5.8 ⇒ v2.8.3 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] ↑ Preferences v1.3.0 ⇒ v1.5.1 [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [66db9d55] - SnoopPrecompile v1.0.3 [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.103.2 [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.1 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.7.0+0 Test Successfully re-resolved Status `/tmp/jl_TTtAJr/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_TTtAJr/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] TestEnv v1.103.2 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 780.2 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.54 seconds. [ Info: Scheduling 1 tests on pid 72 17:08:35 | maxrss 2.1% | mem 3.2% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 17:08:40 | maxrss 2.1% | mem 3.2% | DONE (1/1) test item "TestProjectFile" 5.5 secs (22.6% compile, 5.9% recompile), 725.05 K allocs (42.830 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 72 Precompiling packages... 4065.2 ms ✓ InlineStrings 1 dependency successfully precompiled in 4 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 8.7s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 5.5s test-only dep on InlineStrings | 1 1 5.1s Testing TestProjectFile tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing TestEndExpr Status `/tmp/jl_uHRlKs/Project.toml` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_uHRlKs/Manifest.toml` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [loaded: v1.103.2] [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling packages... 4568.6 ms ✓ TestEnv 10464.0 ms ✓ ReTestItems 2 dependencies successfully precompiled in 15 seconds. 29 already precompiled. 1 dependency had output during precompilation: ┌ TestEnv │ WARNING: Imported binding Operations.project_rel_path was undeclared at import time during import to TestEnv. └ Precompiling packages... 856.7 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.53 seconds. [ Info: Scheduling 2 tests on pid 84 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 100: [ Info: Starting test worker 1 on pid = 100, with 2 threads [ Info: Starting running test items Worker 100: 17:09:45 | maxrss 1.6% | mem 3.9% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 100: 17:09:46 | maxrss 1.6% | mem 3.9% | DONE (1/2) test item "correct usage" 0.4 secs (97.8% compile), 76.48 K allocs (4.115 MB) Worker 100: 17:09:48 | maxrss 1.6% | mem 4.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 100: 17:09:48 | maxrss 1.6% | mem 4.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (78.3% compile), 2.51 K allocs (134.144 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=100). Worker 100: [100] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7e23593abf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 29.2s Testing TestEndExpr tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing TestOnlyDeps Status `/tmp/jl_LvAZXE/Project.toml` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [76c907bd] TestOnlyDeps v0.1.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 Status `/tmp/jl_LvAZXE/Manifest.toml` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` ⌃ [1e6cf692] TestEnv v1.102.2 [loaded: v1.103.2] [76c907bd] TestOnlyDeps v0.1.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling packages... 4552.3 ms ✓ TestEnv 10011.6 ms ✓ ReTestItems 2 dependencies successfully precompiled in 15 seconds. 29 already precompiled. 1 dependency had output during precompilation: ┌ TestEnv │ WARNING: Imported binding Operations.project_rel_path was undeclared at import time during import to TestEnv. └ Precompiling packages... 754.1 ms ✓ TestOnlyDeps 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `TestOnlyDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl [ Info: Finished scanning for test items in 5.56 seconds. [ Info: Scheduling 2 tests on pid 107 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 123: [ Info: Starting test worker 1 on pid = 123, with 2 threads [ Info: Starting running test items Worker 123: 17:10:53 | maxrss 1.7% | mem 4.0% | START (1/2) test item "use a test-only dep" at test/deps_tests.jl:1 Worker 123: 17:10:54 | maxrss 1.7% | mem 4.0% | DONE (1/2) test item "use a test-only dep" 0.2 secs (92.8% compile), 24.31 K allocs (1.360 MB) Worker 123: 17:10:56 | maxrss 1.7% | mem 4.0% | START (2/2) test item "deps as expected" at test/deps_tests.jl:6 Worker 123: 17:10:56 | maxrss 1.7% | mem 4.0% | DONE (2/2) test item "deps as expected" <0.1 secs (69.7% compile), 2.33 K allocs (131.664 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=123). Worker 123: [123] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestOnlyDeps | 2 2 29.2s Testing TestOnlyDeps tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing DontPass Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_ytMrRx/Project.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_ytMrRx/Manifest.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.103.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.1 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.11.4 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.15.0+0 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.7.0+0 Test Successfully re-resolved Status `/tmp/jl_ytMrRx/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [37e2e46d] LinearAlgebra v1.12.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_ytMrRx/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... Precompiling packages... 760.1 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.42 seconds. [ Info: Scheduling 9 tests on pid 130 17:11:24 | maxrss 2.1% | mem 3.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:11:25 | maxrss 2.1% | mem 3.2% | DONE (1/9) test item "do_thing Pass" 0.7 secs (99.1% compile), 213.69 K allocs (11.012 MB) 17:11:25 | maxrss 2.1% | mem 3.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:11:25 | maxrss 2.1% | mem 3.2% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.4% compile), 106.68 K allocs (5.923 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 130 Error in testset "do_thing Fail" on worker 130: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.28107803988804547, 0.05578452830819525, 0.03309621242724792] == 1 17:11:26 | maxrss 2.1% | mem 3.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:11:29 | maxrss 2.1% | mem 3.3% | DONE (3/9) test item "do_thing Error" 3.2 secs (90.6% compile, 3.0% GC), 1.99 M allocs (117.614 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 130 Error in testset "do_thing Error" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 17:11:29 | maxrss 2.1% | mem 3.3% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:11:30 | maxrss 2.1% | mem 3.3% | DONE (4/9) test item "bad setup, good test" 0.6 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 130 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 130 Error in testset "bad setup, good test" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [22] #runtests#36 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:276 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:273 [inlined] [24] #runtests#35 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:272 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [30] _start() @ Base ./client.jl:550 17:11:30 | maxrss 2.1% | mem 3.3% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:11:30 | maxrss 2.1% | mem 3.3% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 130 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 130 Error in testset "bad setup, bad test" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [22] #runtests#36 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:276 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:273 [inlined] [24] #runtests#35 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:272 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [30] _start() @ Base ./client.jl:550 17:11:30 | maxrss 2.1% | mem 3.3% | START (6/9) test item "errors" at test/error_tests.jl:1 17:11:32 | maxrss 2.1% | mem 3.3% | DONE (6/9) test item "errors" 1.7 secs (97.0% compile), 549.87 K allocs (31.035 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 130 Error in testset "UndefVarError" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#295"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#295"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [10] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [11] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [12] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [13] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [14] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [15] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [16] open @ ./io.jl:407 [inlined] [17] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [20] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [26] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [27] #runtests#36 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:276 [inlined] [28] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:273 [inlined] [29] #runtests#35 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:272 [inlined] [30] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [35] _start() @ Base ./client.jl:550 17:11:32 | maxrss 2.1% | mem 3.3% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 17:11:32 | maxrss 2.1% | mem 3.3% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 130 Error in testset "errors at the top level" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [21] #runtests#36 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:276 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:273 [inlined] [23] #runtests#35 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:272 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [26] top-level scope @ none:6 [27] eval(m::Module, e::Any) @ Core ./boot.jl:489 [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [29] _start() @ Base ./client.jl:550 17:11:32 | maxrss 2.1% | mem 3.3% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:11:32 | maxrss 2.1% | mem 3.3% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 130 Error in testset "nonexistent test setup" on worker 130: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [21] #runtests#36 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:276 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:273 [inlined] [23] #runtests#35 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:272 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [26] top-level scope @ none:6 [27] eval(m::Module, e::Any) @ Core ./boot.jl:489 [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [29] _start() @ Base ./client.jl:550 17:11:32 | maxrss 2.1% | mem 3.3% | START (9/9) test item "failures" at test/failure_tests.jl:1 17:11:32 | maxrss 2.1% | mem 3.3% | DONE (9/9) test item "failures" <0.1 secs (70.6% compile), 5.03 K allocs (245.376 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 130 Error in testset "failures" on worker 130: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 130: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.1290642081360002 < 0 Error in testset "failures" on worker 130: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 11.9s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 3.2s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.6s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 1.9s UndefVarError | 2 2 1.3s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.2s errors at the top level | 1 1 2 0.2s nonexistent test setup | 1 1 0.1s test/failure_tests.jl | 3 3 failures | 3 3 0.0s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:11:34 | maxrss 2.1% | mem 2.2% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.07 K allocs (60.640 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.62 K allocs (118.888 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 17:11:34 | maxrss 2.1% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (60.352 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.81 K allocs (126.200 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (59.904 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.07 K allocs (172.408 KB) 17:11:34 | maxrss 2.1% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 17:11:34 | maxrss 2.1% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.66 K allocs (82.640 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.12/activate_set.jl:78 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:11:34 | maxrss 2.1% | mem 2.2% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 17:11:35 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "TestProjectFile" 0.8 secs (84.6% compile, 83.5% recompile), 606.45 K allocs (34.574 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 [ Info: Scanning for test items in project `TestOnlyDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 17:11:50 | maxrss 2.2% | mem 2.2% | START (1/2) test item "use a test-only dep" at test/deps_tests.jl:1 17:11:50 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "use a test-only dep" <0.1 secs (<0.1% compile), 3.15 K allocs (186.488 KB) 17:11:50 | maxrss 2.2% | mem 2.2% | START (2/2) test item "deps as expected" at test/deps_tests.jl:6 17:11:50 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "deps as expected" <0.1 secs (<0.1% compile), 1.69 K allocs (100.112 KB) [ Tests Completed: 2/2 test items were run. Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.12/activate_set.jl:78 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 9 tests on pid 15 17:11:50 | maxrss 2.2% | mem 2.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:11:50 | maxrss 2.2% | mem 2.2% | DONE (1/9) test item "do_thing Pass" <0.1 secs (78.2% compile), 13.85 K allocs (755.544 KB) 17:11:50 | maxrss 2.2% | mem 2.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:11:51 | maxrss 2.2% | mem 2.2% | DONE (2/9) test item "do_thing Fail" 0.2 secs (98.6% compile), 109.36 K allocs (6.076 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.09039231088425714, 0.07190696453340872, 0.9960432518655878] == 1 17:11:51 | maxrss 2.2% | mem 2.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:11:52 | maxrss 2.2% | mem 2.2% | DONE (3/9) test item "do_thing Error" 1.2 secs (90.6% compile, 3.9% recompile, 28.6% GC), 1.04 M allocs (62.641 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 17:11:52 | maxrss 2.2% | mem 2.2% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (4/9) test item "bad setup, good test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [24] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [25] #318 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:225 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#318#319"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#318#319"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#318#319", String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#318#319", name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [35] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:194 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [43] IncludeInto @ ./Base.jl:308 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:11:53 | maxrss 2.2% | mem 2.2% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [24] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [25] #318 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:225 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#318#319"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#318#319"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#318#319", String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#318#319", name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [35] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:194 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [43] IncludeInto @ ./Base.jl:308 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:11:53 | maxrss 2.2% | mem 2.2% | START (6/9) test item "errors" at test/error_tests.jl:1 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (6/9) test item "errors" 0.2 secs (76.6% compile), 67.92 K allocs (4.419 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#493"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#493"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [10] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [11] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [12] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [13] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [14] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [15] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [16] open @ ./io.jl:407 [inlined] [17] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [20] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [27] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [28] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [29] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [30] #318 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:225 [inlined] [31] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [32] activate(f::var"#with_test_package##4#with_test_package##5"{var"#318#319"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [33] #with_test_package##2 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:33 [inlined] [34] cd(f::var"#with_test_package##2#with_test_package##3"{var"#318#319"}, dir::String) @ Base.Filesystem ./file.jl:112 [35] #with_test_package##0 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:32 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#318#319", String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [39] with_test_package(f::var"#318#319", name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [40] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:194 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [47] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [48] IncludeInto @ ./Base.jl:308 [inlined] [49] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [50] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [51] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [52] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [53] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [54] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [55] top-level scope @ none:6 [56] eval(m::Module, e::Any) @ Core ./boot.jl:489 [57] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:11:53 | maxrss 2.2% | mem 2.2% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [24] #318 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:225 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#318#319"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#318#319"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#318#319", String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#318#319", name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [34] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:194 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [42] IncludeInto @ ./Base.jl:308 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:11:53 | maxrss 2.2% | mem 2.2% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:298 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [24] #318 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:225 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#318#319"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#318#319"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#318#319", String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#318#319", name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [34] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:194 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:224 [inlined] --- the above 2 lines are repeated 1 more time --- [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [42] IncludeInto @ ./Base.jl:308 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:11:53 | maxrss 2.2% | mem 2.2% | START (9/9) test item "failures" at test/failure_tests.jl:1 17:11:53 | maxrss 2.2% | mem 2.2% | DONE (9/9) test item "failures" <0.1 secs (73.0% compile), 5.09 K allocs (249.680 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.2947985355387704 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.12/activate_set.jl:78 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:19:25 | maxrss 2.2% | mem 2.3% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 17:19:28 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "MonoRepo tests" 3.2 secs (<0.1% compile), 94.32 K allocs (10.364 MB) [ Tests Completed: 1/1 test items were run. ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 Testing C Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_xkaum6/Project.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_xkaum6/Manifest.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/rFUty` ⇒ v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.103.2 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.12.1 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.15.0+0 [e37daf67] + LibGit2_jll v1.9.0+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.11.4 [458c3c95] + OpenSSL_jll v3.5.4+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.64.0+1 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.7.0+0 Test Successfully re-resolved Status `/tmp/jl_xkaum6/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [8dfed614] Test v1.11.0 Status `/tmp/jl_xkaum6/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.1 `~/.julia/packages/ReTestItems/rFUty` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [458c3c95] OpenSSL_jll v3.5.4+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.68 seconds. [ Info: Scheduling 1 tests on pid 255 17:19:54 | maxrss 2.2% | mem 3.3% | START (1/1) test item "C_tests" at test/c_tests.jl:1 17:19:55 | maxrss 2.2% | mem 3.3% | DONE (1/1) test item "C_tests" 0.3 secs (96.4% compile), 51.64 K allocs (2.800 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 4.1s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.3s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.12/activate_set.jl:78 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:19:57 | maxrss 2.2% | mem 2.3% | START (1/1) test item "C_tests" at test/c_tests.jl:1 17:19:57 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 1.81 K allocs (93.312 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:19:57 | maxrss 2.2% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:19:57 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.07 K allocs (172.120 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:19:59 | maxrss 2.2% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:19:59 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (171.480 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:19:59 | maxrss 2.2% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:19:59 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (170.936 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 17:19:59 | maxrss 2.2% | mem 2.3% | START (1/2) test item "bar" at src/bar_tests.jl:1 17:19:59 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (170.968 KB) 17:19:59 | maxrss 2.2% | mem 2.3% | START (2/2) test item "foo" at src/foo_test.jl:1 17:19:59 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 1.66 K allocs (81.744 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:01 | maxrss 2.2% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:20:01 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (170.936 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 8 tests on pid 15 17:20:01 | maxrss 2.3% | mem 2.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:20:01 | maxrss 2.3% | mem 2.3% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:01 | maxrss 2.3% | mem 2.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.82 K allocs (127.592 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (60.160 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (170.936 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (8/8) test item "foo" at src/foo_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (81.360 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 17:20:02 | maxrss 2.3% | mem 2.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.81 K allocs (126.200 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.06 K allocs (63.464 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.05 K allocs (59.536 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.05 K allocs (61.168 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.04 K allocs (170.936 KB) 17:20:02 | maxrss 2.3% | mem 2.3% | START (8/8) test item "foo" at src/foo_test.jl:1 17:20:02 | maxrss 2.3% | mem 2.3% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.65 K allocs (81.360 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:152 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:04 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:04 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (60.336 KB) 17:20:04 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:04 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:04 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:04 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (63.480 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scheduling 2 tests on pid 15 17:20:06 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:06 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:06 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:06 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scheduling 2 tests on pid 15 17:20:07 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:07 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:07 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:07 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (61.944 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:07 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:07 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:07 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:08 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.24 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:09 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:09 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:10 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:10 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:10 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:10 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.400 KB) 17:20:10 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:10 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:11 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:11 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:13 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:13 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:15 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:15 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:15 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:15 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:15 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:15 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.608 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:20:15 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:15 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:15 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:15 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:20:16 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:16 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:16 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:16 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:16 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:16 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:16 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:16 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:16 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:16 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (60.688 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:23 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:23 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:23 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:20:23 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (62.376 KB) 17:20:23 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:23 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:20:23 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:23 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:23 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (60.864 KB) 17:20:23 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:23 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.16 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 3 tests on pid 15 17:20:33 | maxrss 2.3% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:20:33 | maxrss 2.3% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) 17:20:33 | maxrss 2.3% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:20:33 | maxrss 2.3% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.06 K allocs (59.776 KB) 17:20:33 | maxrss 2.3% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:20:33 | maxrss 2.3% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.06 K allocs (59.792 KB) [ Tests Completed: 3/3 test items were run. 17:20:33 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 17:20:33 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 6.72 K allocs (272.776 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:597 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 259: [ Info: Starting test worker 1 on pid = 259, with 2 threads\n[ Info: Starting running test items\n Worker 259: 17:20:51 | maxrss 2.3% | mem 3.1% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 259: 17:20:54 | maxrss 2.3% | mem 3.2% | DONE (1/2) test item \"bad setup, good test\" 2.8 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2403 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2386\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2362\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977\n [9] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1411\n [10] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108\n [11] macro expansion\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined]\n [12] macro expansion\n @ ./lock.jl:376 [inlined]\n [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989\n [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120\n [15] top-level scope\n @ none:1\n [16] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [17] execute\n @ ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined]\n [18] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:348\n\n Worker 259: 17:20:55 | maxrss 2.3% | mem 3.2% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 259: 17:20:55 | maxrss 2.3% | mem 3.2% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2403 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2386\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2362\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977\n [9] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1411\n [10] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108\n [11] macro expansion\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined]\n [12] macro expansion\n @ ./lock.jl:376 [inlined]\n [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989\n [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120\n [15] top-level scope\n @ none:1\n [16] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [17] execute\n @ ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined]\n [18] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=259).\n Worker 259: [259] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:585 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:597 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:603 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 259: [ Info: Starting test worker 1 on pid = 259, with 2 threads\n[ Info: Starting running test items\n Worker 259: 17:20:51 | maxrss 2.3% | mem 3.1% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 259: 17:20:54 | maxrss 2.3% | mem 3.2% | DONE (1/2) test item \"bad setup, good test\" 2.8 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2403 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2386\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2362\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977\n [9] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1411\n [10] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108\n [11] macro expansion\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined]\n [12] macro expansion\n @ ./lock.jl:376 [inlined]\n [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989\n [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120\n [15] top-level scope\n @ none:1\n [16] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [17] execute\n @ ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined]\n [18] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:348\n\n Worker 259: 17:20:55 | maxrss 2.3% | mem 3.2% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 259: 17:20:55 | maxrss 2.3% | mem 3.2% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2403 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2386\n [4] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2362\n [5] top-level scope\n @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [6] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [7] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined]\n [8] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977\n [9] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1411\n [10] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108\n [11] macro expansion\n @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined]\n [12] macro expansion\n @ ./lock.jl:376 [inlined]\n [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989\n [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120\n [15] top-level scope\n @ none:1\n [16] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [17] execute\n @ ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined]\n [18] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/rFUty/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=259).\n Worker 259: [259] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:585 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:603 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 280: [ Info: Starting test worker 1 on pid = 280, with 2 threads [ Info: Starting running test items Worker 280: 17:21:44 | maxrss 2.4% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 280: 17:21:45 | maxrss 2.4% | mem 3.2% | DONE (1/6) test item "Pass on second run" 0.2 secs (96.0% compile), 7.78 K allocs (386.800 KB) Worker 280: julia: /source/src/threading.c:1033: _jl_mutex_unlock_nogc: Assertion `__extension__ ({ __auto_type __atomic_load_ptr = (&lock->owner); __typeof__ (*__atomic_load_ptr) __atomic_load_tmp; __atomic_load (__atomic_load_ptr, &__atomic_load_tmp, (memory_order_relaxed)); __atomic_load_tmp; }) == (((jl_task_t *) ((char *)(ijl_get_pgcstack()) - __builtin_offsetof (jl_task_t, gcstack)))) && "Unlocking a lock in a different thread."' failed. Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 280 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 280 ┌ Error: Worker(pid=280, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 287: [ Info: Starting test worker on pid = 287, with 2 threads Worker 287: 17:21:59 | maxrss 2.4% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 287: 17:22:00 | maxrss 2.4% | mem 3.2% | DONE (1/6) test item "Pass on second run" 0.2 secs (96.4% compile), 7.78 K allocs (386.800 KB) Worker 287: [287] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7dc846fbcf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 287 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 287 ┌ Error: Worker(pid=287, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 294: [ Info: Starting test worker on pid = 294, with 2 threads Worker 294: 17:22:13 | maxrss 2.4% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 294: 17:22:14 | maxrss 2.4% | mem 3.2% | DONE (1/6) test item "Pass on second run" 0.2 secs (96.2% compile), 7.78 K allocs (386.800 KB) Worker 294: [294] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x74f87ad31f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 294 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 294 ┌ Error: Worker(pid=294, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 301: [ Info: Starting test worker on pid = 301, with 2 threads Worker 301: 17:22:28 | maxrss 2.4% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured logs for test setup "StatefulSetup" (dependency of "Error, then Fail, then Pass") at test/testfiles/_retry_tests.jl:1 on worker 301 These are the test setup logs. Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 301 [301] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7860cf70af14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7860cf70e1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7860cf78e85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7860cf70af14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 _trywait at ./asyncevent.jl:163 profile_printing_listener at ./Base.jl:332 #start_profile_listener##0 at ./Base.jl:352 jfptr_YY.start_profile_listenerYY.YY.0_9934.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) gc_page_data at /source/src/gc-stock.h:332 [inlined] jl_gc_small_alloc_inner at /source/src/gc-stock.c:738 ijl_gc_small_alloc at /source/src/gc-stock.c:775 GenericMemory at ./boot.jl:588 [inlined] Array at ./boot.jl:647 [inlined] getindex at ./array.jl:405 [inlined] update_level! at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:286 compute_domtree_nodes! at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:277 construct_postdomtree at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:245 construct_postdomtree at ./../usr/share/julia/Compiler/src/ssair/ir.jl:480 [inlined] construct_postdomtree at ./../usr/share/julia/Compiler/src/ssair/ir.jl:479 [inlined] get! at ./../usr/share/julia/Compiler/src/inferencestate.jl:191 [inlined] visit_conditional_successors at ./../usr/share/julia/Compiler/src/optimize.jl:567 jfptr_visit_conditional_successors_48387.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_invoke at /source/src/gf.c:4017 tojlinvoke84438.1 at /opt/julia/lib/julia/sys.so (unknown line) j_visit_conditional_successors_81705.1 at /opt/julia/lib/julia/sys.so (unknown line) ScanStmt at ./../usr/share/julia/Compiler/src/optimize.jl:858 scan! at ./../usr/share/julia/Compiler/src/ssair/irinterp.jl:286 ipo_dataflow_analysis! at ./../usr/share/julia/Compiler/src/optimize.jl:968 optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1003 jfptr_optimize_81947.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:202 jfptr_finish_nocycle_81800.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4508 const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1349 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:899 abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:168 infercalls at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:252 abstract_call_gf_by_type at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:338 abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2783 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2890 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2883 [inlined] abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3043 abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3386 abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3836 [inlined] abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3793 [inlined] typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4343 jfptr_typeinf_local_83491.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4501 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1254 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1437 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1446 jfptr_typeinf_ext_toplevel_80948.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3512 _jl_invoke at /source/src/gf.c:4002 [inlined] ijl_apply_generic at /source/src/gf.c:4210 show_exception_stack at ./errorshow.jl:1016 #sprint#437 at ./strings/io.jl:110 unknown function (ip: 0x7860a9b3b1bd) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 sprint at ./strings/io.jl:110 unknown function (ip: 0x7860a9b3af1d) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_f_invokelatest at /source/src/builtins.c:881 _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_f__apply_iterate at /source/src/builtins.c:868 invokelatest at ./Base_compiler.jl:250 _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 Error at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:234 do_test at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:710 jfptr_do_test_2989.1 at /opt/julia/share/julia/compiled/v1.12/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_eval_module_expr at /source/src/toplevel.c:197 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:814 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 #79 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 #77 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 #redirect_stdio#650 at ./stream.jl:1448 _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] #open#330 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] #runtestitem#72 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 unknown function (ip: 0x7860a9b22c94) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:348 unknown function (ip: 0x7860a9b0f7ed) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 wait_readnb at ./stream.jl:392 eof at ./stream.jl:106 [inlined] read at ./stream.jl:1012 deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:851 [inlined] deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:838 serve_requests at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:340 startworker at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:310 unknown function (ip: 0x7860a9b0866f) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_toplevel_eval_flex at /source/src/toplevel.c:975 jl_toplevel_eval_flex at /source/src/toplevel.c:975 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 exec_options at ./client.jl:283 _start at ./client.jl:550 jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] true_main at /source/src/jlapi.c:971 jl_repl_entrypoint at /source/src/jlapi.c:1139 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7860cf6ac249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) Allocations: 3996148 (Pool: 3996084; Big: 64); GC: 5 These are the logs for run number: 1 ┌ Error: Worker(pid=301, terminated=true, termsignal=15) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 308: [ Info: Starting test worker on pid = 308, with 2 threads Worker 308: 17:22:42 | maxrss 2.4% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 308 [308] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7900c95b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7900c95b41c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7900c963485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7900c95b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 _trywait at ./asyncevent.jl:163 profile_printing_listener at ./Base.jl:332 #start_profile_listener##0 at ./Base.jl:352 jfptr_YY.start_profile_listenerYY.YY.0_9934.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) ┌ Error: Worker(pid=308, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 315: [ Info: Starting test worker on pid = 315, with 2 threads Worker 315: 17:22:56 | maxrss 2.4% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured logs for test setup "StatefulSetup" (dependency of "Error, then Fail, then Pass") at test/testfiles/_retry_tests.jl:1 on worker 315 These are the test setup logs. Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 315 [315] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7ccbba21df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7ccbba2211c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7ccbba2a185b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7ccbba21df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 _trywait at ./asyncevent.jl:163 profile_printing_listener at ./Base.jl:332 #start_profile_listener##0 at ./Base.jl:352 jfptr_YY.start_profile_listenerYY.YY.0_9934.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) stmt_effect_flags at ./../usr/share/julia/Compiler/src/optimize.jl:0 recompute_effects_flags at ./../usr/share/julia/Compiler/src/optimize.jl:386 [inlined] add_inst_flag! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1218 [inlined] add_inst_flag! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1215 [inlined] process_simple! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1231 assemble_inline_todo! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1618 ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:76 [inlined] run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1013 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1027 [inlined] optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1002 jfptr_optimize_81947.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:202 jfptr_finish_nocycle_81800.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4508 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1254 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1437 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1446 jfptr_typeinf_ext_toplevel_80948.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3512 _jl_invoke at /source/src/gf.c:4002 [inlined] ijl_apply_generic at /source/src/gf.c:4210 show_exception_stack at ./errorshow.jl:1016 #sprint#437 at ./strings/io.jl:110 unknown function (ip: 0x7ccb94b3b3dd) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 sprint at ./strings/io.jl:110 unknown function (ip: 0x7ccb94b3b13d) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_f_invokelatest at /source/src/builtins.c:881 _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_f__apply_iterate at /source/src/builtins.c:868 invokelatest at ./Base_compiler.jl:250 _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 Error at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:234 do_test at /source/usr/share/julia/stdlib/v1.12/Test/src/Test.jl:710 jfptr_do_test_2989.1 at /opt/julia/share/julia/compiled/v1.12/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_eval_module_expr at /source/src/toplevel.c:197 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:814 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 #79 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 #77 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 #redirect_stdio#650 at ./stream.jl:1448 _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] #open#330 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] #runtestitem#72 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 unknown function (ip: 0x7ccb94b313d4) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:348 unknown function (ip: 0x7ccb94b0f2ed) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 wait_readnb at ./stream.jl:392 eof at ./stream.jl:106 [inlined] read at ./stream.jl:1012 deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:851 [inlined] deserialize at /source/usr/share/julia/stdlib/v1.12/Serialization/src/Serialization.jl:838 serve_requests at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:340 startworker at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/workers.jl:310 unknown function (ip: 0x7ccb94b08f5f) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_toplevel_eval_flex at /source/src/toplevel.c:975 jl_toplevel_eval_flex at /source/src/toplevel.c:975 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 exec_options at ./client.jl:283 _start at ./client.jl:550 jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] true_main at /source/src/jlapi.c:971 jl_repl_entrypoint at /source/src/jlapi.c:1139 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7ccbba1bf249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) Allocations: 4000663 (Pool: 4000598; Big: 65); GC: 5 These are the logs for run number: 1 ┌ Error: Worker(pid=315, terminated=true, termsignal=15) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 322: [ Info: Starting test worker on pid = 322, with 2 threads Worker 322: 17:23:10 | maxrss 2.4% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 322: 17:23:11 | maxrss 2.4% | mem 3.2% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.4% compile), 7.67 K allocs (382.144 KB) Worker 322: [322] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 322 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 322 ┌ Error: Worker(pid=322, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 329: [ Info: Starting test worker on pid = 329, with 2 threads Worker 329: 17:23:24 | maxrss 2.4% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 329: 17:23:25 | maxrss 2.4% | mem 3.2% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.5% compile), 7.67 K allocs (382.144 KB) Worker 329: [329] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 329 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 329 ┌ Error: Worker(pid=329, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 336: [ Info: Starting test worker on pid = 336, with 2 threads Worker 336: 17:23:39 | maxrss 2.4% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 336: 17:23:40 | maxrss 2.4% | mem 3.2% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.6% compile), 7.67 K allocs (382.144 KB) Worker 336: [336] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 336 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 336 ┌ Error: Worker(pid=336, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 343: [ Info: Starting test worker on pid = 343, with 2 threads Worker 343: 17:23:53 | maxrss 2.4% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 343: 17:23:54 | maxrss 2.4% | mem 3.2% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.4% compile), 7.67 K allocs (382.144 KB) Worker 343: [343] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 343 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 343 ┌ Error: Worker(pid=343, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 350: [ Info: Starting test worker on pid = 350, with 2 threads Worker 350: 17:24:08 | maxrss 2.4% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 350: 17:24:09 | maxrss 2.4% | mem 3.2% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (96.6% compile), 7.67 K allocs (382.144 KB) Worker 350: [350] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 350 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 350 ┌ Error: Worker(pid=350, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 357: [ Info: Starting test worker on pid = 357, with 2 threads Worker 357: 17:24:22 | maxrss 2.4% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 357: 17:24:23 | maxrss 2.4% | mem 3.2% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.5% compile), 7.67 K allocs (382.144 KB) Worker 357: [357] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 357 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 357 ┌ Error: Worker(pid=357, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 364: [ Info: Starting test worker on pid = 364, with 2 threads Worker 364: 17:24:37 | maxrss 2.4% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 364: 17:24:38 | maxrss 2.4% | mem 3.2% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.5% compile), 7.67 K allocs (382.144 KB) Worker 364: [364] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7f21cd554f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 364 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 364 ┌ Error: Worker(pid=364, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 371: [ Info: Starting test worker on pid = 371, with 2 threads Worker 371: 17:24:51 | maxrss 2.4% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 371: 17:24:52 | maxrss 2.4% | mem 3.2% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (96.3% compile), 7.67 K allocs (382.144 KB) Worker 371: [371] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 371 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 371 ┌ Error: Worker(pid=371, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 378: [ Info: Starting test worker on pid = 378, with 2 threads Worker 378: 17:25:06 | maxrss 2.4% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 378 [378] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7b3b777a1f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7b3b777a51c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7b3b7782585b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7b3b777a1f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=378, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 385: [ Info: Starting test worker on pid = 385, with 2 threads Worker 385: 17:25:20 | maxrss 2.4% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 385 [385] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x77d5ab27ef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x77d5ab2821c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x77d5ab30285b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x77d5ab27ef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=385, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 392: [ Info: Starting test worker on pid = 392, with 2 threads Worker 392: 17:25:35 | maxrss 2.4% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 392 [392] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x75c27e758f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x75c27e75c1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x75c27e7dc85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x75c27e758f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=392, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 399: [ Info: Starting test worker on pid = 399, with 2 threads Worker 399: 17:25:49 | maxrss 2.4% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 399 [399] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x738738a61f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x738738a651c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x738738ae585b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x738738a61f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=399, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 406: [ Info: Starting test worker on pid = 406, with 2 threads Worker 406: 17:26:04 | maxrss 2.4% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 406: 17:26:05 | maxrss 2.4% | mem 3.2% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (97.0% compile), 156.09 K allocs (8.447 MB) Worker 406: [406] signal 15: Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 406 ┌ Error: Worker(pid=406, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=3. Worker 413: [ Info: Starting test worker on pid = 413, with 2 threads Worker 413: 17:26:18 | maxrss 2.4% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 413: 17:26:19 | maxrss 2.4% | mem 3.2% | DONE (6/6) test item "Timeout first, pass after" 0.4 secs (97.0% compile), 156.09 K allocs (8.447 MB) Worker 413: [413] signal 15: Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 413 ┌ Error: Worker(pid=413, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=413, terminated=true, termsignal=9). [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:663 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:663 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:665 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:665 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:668 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:668 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:671 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:671 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:676 Expression: count(contains("num_runs_6"), readdir(tmpdir)) == 2 Evaluated: 3 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:676 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:681 Expression: n_passed(results) == 3 Evaluated: 0 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:652 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:681 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/rFUty/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/rFUty/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:871 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:871 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 420: [ Info: Starting test worker 1 on pid = 420, with 2 threads [ Info: Starting running test items Worker 420: 17:26:35 | maxrss 2.4% | mem 3.2% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 420 [420] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7976f83b1f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7976f83b51c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7976f843585b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7976f83b1f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=420, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 427: [ Info: Starting test worker on pid = 427, with 2 threads Worker 427: 17:26:49 | maxrss 2.4% | mem 3.2% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 427: 17:26:49 | maxrss 2.4% | mem 3.2% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (97.2% compile), 23.26 K allocs (1.258 MB) Worker 427: [427] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 427 ┌ Error: Worker(pid=427, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=427, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:754 | Worker 1 closed: Worker(pid=427, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:721 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:714 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:721 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:713 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:714 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:723 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [9] IncludeInto @ ./Base.jl:308 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [19] _start() @ Base ./client.jl:550 DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/rFUty/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/rFUty/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:844 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:871 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:871 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 434: [ Info: Starting test worker 1 on pid = 434, with 2 threads [ Info: Starting running test items Worker 434: 17:27:03 | maxrss 2.4% | mem 3.2% | START (1/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 434: 17:27:04 | maxrss 2.4% | mem 3.2% | DONE (1/2) test item "Test which should run after timeout" 0.2 secs (96.7% compile), 23.26 K allocs (1.258 MB) Worker 434: [434] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 434 ┌ Error: Worker(pid=434, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 441: [ Info: Starting test worker on pid = 441, with 2 threads Worker 441: 17:27:17 | maxrss 2.4% | mem 3.2% | START (2/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 441 [441] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x729d55a31f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x729d55a351c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x729d55ab585b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x729d55a31f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=441, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=441, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:754 | Worker 1 closed: Worker(pid=441, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:743 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:734 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:743 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:733 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:745 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [9] IncludeInto @ ./Base.jl:308 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [19] _start() @ Base ./client.jl:550 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 448: [ Info: Starting test worker 1 on pid = 448, with 2 threads [ Info: Starting running test items Worker 448: 17:27:31 | maxrss 2.4% | mem 3.2% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 448 [448] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7b3e5caccf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7b3e5cad01c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7b3e5cb5085b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7b3e5caccf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=448, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=448, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 455: [ Info: Starting test worker 1 on pid = 455, with 2 threads [ Info: Starting running test items Worker 455: 17:27:47 | maxrss 2.4% | mem 3.2% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 455 [455] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x71b5f0cc0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x71b5f0cc41c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x71b5f0d4485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x71b5f0cc0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=455, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=455, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 462: [ Info: Starting test worker 1 on pid = 462, with 2 threads [ Info: Starting running test items Worker 462: 17:28:02 | maxrss 2.4% | mem 3.2% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 462 [462] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7a229fcc5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3636 unknown function (ip: 0x7a229fcc91c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7a229fd4985b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7a229fcc5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=462, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=462, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 476: [ Info: Starting test worker 1 on pid = 476, with 3,2 threads [ Info: Starting running test items Worker 476: 17:28:34 | maxrss 2.4% | mem 3.2% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 476: 17:28:34 | maxrss 2.4% | mem 3.2% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (96.3% compile), 23.45 K allocs (1.259 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=476). Worker 476: [476] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:820 overwritten at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:854. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.13 seconds. [ Info: Scheduling 3 tests on pid 15 17:28:38 | maxrss 2.4% | mem 2.4% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.63 K allocs (99.096 KB) 17:28:38 | maxrss 2.4% | mem 2.4% | START (2/3) test item "other A" at test/integrationtests.jl:846 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.29 K allocs (74.000 KB) 17:28:38 | maxrss 2.4% | mem 2.4% | START (3/3) test item "other B" at test/integrationtests.jl:846 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (72.640 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:28:38 | maxrss 2.4% | mem 2.4% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.13 K allocs (62.112 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:28:38 | maxrss 2.4% | mem 2.4% | START (1/2) test item "other A" at test/integrationtests.jl:846 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.29 K allocs (72.640 KB) 17:28:38 | maxrss 2.4% | mem 2.4% | START (2/2) test item "other B" at test/integrationtests.jl:846 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (72.640 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:28:38 | maxrss 2.4% | mem 2.4% | START (1/1) test item "other B" at test/integrationtests.jl:846 17:28:38 | maxrss 2.4% | mem 2.4% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.29 K allocs (72.640 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.68 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:28:39 | maxrss 2.4% | mem 2.4% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 17:28:39 | maxrss 2.4% | mem 2.4% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (59.744 KB) 17:28:39 | maxrss 2.4% | mem 2.4% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 17:28:39 | maxrss 2.4% | mem 2.4% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (59.744 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 486: [ Info: Starting test worker 1 on pid = 486, with 2 threads [ Info: Starting running test items Worker 486: 17:28:52 | maxrss 2.4% | mem 3.2% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 486: 17:28:53 | maxrss 2.4% | mem 3.2% | DONE (1/2) test item "same name" 0.2 secs (97.2% compile), 23.26 K allocs (1.258 MB) Worker 486: 17:28:54 | maxrss 2.4% | mem 3.2% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 486: 17:28:54 | maxrss 2.4% | mem 3.2% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.06 K allocs (61.392 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=486). Worker 486: [486] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7f66d9869f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.09 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 493: [ Info: Starting test worker 1 on pid = 493, with 2 threads [ Info: Starting running test items Worker 493: [493] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7839a708df14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 493 ┌ Error: Worker(pid=493, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 Worker 500: [ Info: Starting test worker on pid = 500, with 2 threads Worker 500: [500] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x74e603311f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 500 ┌ Error: Worker(pid=500, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=500, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:34:49 | maxrss 2.4% | mem 2.4% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.62 K allocs (117.104 KB) 17:34:49 | maxrss 2.4% | mem 2.4% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.15 K allocs (97.968 KB) 17:34:49 | maxrss 2.4% | mem 2.4% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.15 K allocs (101.080 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 17:34:49 | maxrss 2.4% | mem 2.4% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 1.68 K allocs (81.744 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 15 Error in testset "happy 1" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 17:34:49 | maxrss 2.4% | mem 2.4% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.67 K allocs (82.992 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 15 Error in testset "happy 2" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 17:34:49 | maxrss 2.4% | mem 2.4% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 17:34:49 | maxrss 2.4% | mem 2.4% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.67 K allocs (81.360 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 15 Error in testset "happy 3" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 673: [ Info: Starting test worker 1 on pid = 673, with 2 threads [ Info: Starting running test items Worker 673: 17:35:03 | maxrss 2.4% | mem 3.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 673: 17:35:03 | maxrss 2.4% | mem 3.2% | DONE (1/3) test item "happy 1" 0.2 secs (95.9% compile), 23.87 K allocs (1.273 MB) Worker 673: 17:35:04 | maxrss 2.4% | mem 3.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 673: 17:35:04 | maxrss 2.4% | mem 3.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.15 K allocs (99.616 KB) Worker 673: 17:35:05 | maxrss 2.4% | mem 3.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 673: 17:35:05 | maxrss 2.4% | mem 3.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.15 K allocs (98.320 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=673). Worker 673: [673] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7a90d5fa3f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 680: [ Info: Starting test worker 1 on pid = 680, with 2 threads [ Info: Starting running test items Worker 680: 17:35:20 | maxrss 2.4% | mem 3.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 680: 17:35:21 | maxrss 2.4% | mem 3.2% | DONE (1/3) test item "happy 1" 0.2 secs (96.5% compile), 23.40 K allocs (1.257 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 680 Error in testset "happy 1" on worker 680: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 680: 17:35:22 | maxrss 2.4% | mem 3.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 680: 17:35:22 | maxrss 2.4% | mem 3.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.69 K allocs (83.440 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 680 Error in testset "happy 2" on worker 680: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 680: 17:35:24 | maxrss 2.4% | mem 3.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 680: 17:35:24 | maxrss 2.4% | mem 3.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.68 K allocs (81.712 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 680 Error in testset "happy 3" on worker 680: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=680). Worker 680: [680] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 691: [ Info: Starting test worker 2 on pid = 691, with 2 threads Worker 687: [ Info: Starting test worker 1 on pid = 687, with 2 threads [ Info: Starting running test items Worker 687: 17:35:54 | maxrss 2.4% | mem 4.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 691: 17:35:54 | maxrss 2.4% | mem 4.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 687: 17:35:55 | maxrss 2.4% | mem 4.0% | DONE (1/3) test item "happy 1" 0.5 secs (95.2% compile), 23.87 K allocs (1.273 MB) Worker 691: 17:35:55 | maxrss 2.4% | mem 4.0% | DONE (2/3) test item "happy 2" 0.6 secs (96.6% compile), 23.87 K allocs (1.273 MB) Worker 687: 17:35:59 | maxrss 2.4% | mem 4.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 687: 17:35:59 | maxrss 2.4% | mem 4.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.15 K allocs (99.616 KB) [ Info: All tests on worker 2 completed. Closing Worker(pid=691). [ Info: All tests on worker 1 completed. Closing Worker(pid=687). Worker 687: [687] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 703: [ Info: Starting test worker 2 on pid = 703, with 2 threads Worker 701: [ Info: Starting test worker 1 on pid = 701, with 2 threads [ Info: Starting running test items Worker 703: 17:36:30 | maxrss 2.4% | mem 4.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 701: 17:36:30 | maxrss 2.4% | mem 4.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 703: 17:36:31 | maxrss 2.4% | mem 4.0% | DONE (2/3) test item "happy 2" 0.5 secs (97.6% compile), 23.40 K allocs (1.257 MB) Worker 701: 17:36:32 | maxrss 2.4% | mem 4.0% | DONE (1/3) test item "happy 1" 0.6 secs (97.2% compile), 23.40 K allocs (1.257 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 703 Error in testset "happy 2" on worker 703: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 701 Error in testset "happy 1" on worker 701: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 703: 17:36:36 | maxrss 2.4% | mem 4.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 703: 17:36:36 | maxrss 2.4% | mem 4.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.68 K allocs (83.008 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=701). Worker 701: [701] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x71ff3ae6cf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 703 Error in testset "happy 3" on worker 703: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=703). Worker 703: [703] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 715: [ Info: Starting test worker 1 on pid = 715, with 2 threads [ Info: Starting running test items Worker 715: 17:36:52 | maxrss 2.4% | mem 3.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 715: 17:36:53 | maxrss 2.4% | mem 3.2% | DONE (1/3) test item "happy 1" 0.3 secs (96.8% compile), 23.93 K allocs (1.284 MB) Worker 715: 17:36:54 | maxrss 2.4% | mem 3.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 715: 17:36:54 | maxrss 2.4% | mem 3.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.57 K allocs (79.312 KB) Worker 715: 17:36:55 | maxrss 2.4% | mem 3.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 715: 17:36:55 | maxrss 2.4% | mem 3.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.57 K allocs (77.984 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=715). Worker 715: [715] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1088 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 16.5s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1088 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 722: [ Info: Starting test worker 1 on pid = 722, with 2 threads [ Info: Starting running test items Worker 722: 17:37:10 | maxrss 2.4% | mem 3.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 722: 17:37:11 | maxrss 2.4% | mem 3.2% | DONE (1/3) test item "happy 1" 0.4 secs (96.7% compile), 67.33 K allocs (3.692 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 722 Error in testset "post-testitem" on worker 722: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1099 Expression: false Worker 722: 17:37:12 | maxrss 2.4% | mem 3.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 722: 17:37:12 | maxrss 2.4% | mem 3.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.19 K allocs (135.576 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 722 Error in testset "post-testitem" on worker 722: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1099 Expression: false Worker 722: 17:37:15 | maxrss 2.4% | mem 3.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 722: 17:37:15 | maxrss 2.4% | mem 3.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.19 K allocs (134.152 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 722 Error in testset "post-testitem" on worker 722: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1099 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=722). Worker 722: [722] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1110 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 20.2s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1110 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1117 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 20.2s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1045 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1076 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1117 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Activating project at `~/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1308 [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 729: [ Info: Starting test worker 1 on pid = 729, with 2 threads [ Info: Starting running test items Worker 729: 17:37:30 | maxrss 2.4% | mem 3.2% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 729: 17:37:31 | maxrss 2.4% | mem 3.2% | DONE (1/2) test item "correct usage" 0.4 secs (93.8% compile), 76.48 K allocs (4.115 MB) Worker 729: 17:37:32 | maxrss 2.4% | mem 3.2% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 729: 17:37:32 | maxrss 2.4% | mem 3.2% | DONE (2/2) test item "incorrect usage" <0.1 secs (80.1% compile), 2.51 K allocs (134.144 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=729). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 736: [ Info: Starting test worker 1 on pid = 736, with 2 threads [ Info: Starting running test items Worker 736: 17:37:47 | maxrss 2.4% | mem 3.2% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 736: 17:37:48 | maxrss 2.4% | mem 3.2% | DONE (1/2) test item "correct usage" 0.8 secs (97.9% compile), 281.29 K allocs (15.459 MB) Worker 736: 17:37:49 | maxrss 2.4% | mem 3.2% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 736: 17:37:49 | maxrss 2.4% | mem 3.2% | DONE (2/2) test item "incorrect usage" <0.1 secs (53.9% compile), 5.14 K allocs (231.176 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 736 Error in testset "no pins left at end of test" on worker 736: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1143 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=736). Worker 736: [736] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7a89e25b5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 15 17:37:53 | maxrss 2.4% | mem 2.4% | START (1/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (1/9) test item "do_thing Fail" 0.3 secs (97.3% compile, 83.6% recompile), 95.00 K allocs (5.099 MB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 [ Info: RUNNING Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.8741984833036555, 0.7894771589695926, 0.6076260262562998] == 1 17:37:53 | maxrss 2.4% | mem 2.4% | START (2/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (2/9) test item "do_thing Error" <0.1 secs (<0.1% compile), 54.12 K allocs (7.294 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 [ Info: RUNNING Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:642 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 +(::Integer, !Matched::AbstractChar) @ Base char.jl:257 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] 17:37:53 | maxrss 2.4% | mem 2.4% | START (3/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (3/9) test item "bad setup, good test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [24] #521 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1165 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#521#522"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [27] cd(f::var"#with_test_package##2#with_test_package##3"{var"#521#522"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:107 [28] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#521#522"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:51 [29] with_test_package(f::var"#521#522"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [30] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1156 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1159 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1164 [inlined] [37] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [38] IncludeInto @ ./Base.jl:308 [inlined] [39] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [40] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [41] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [44] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [45] top-level scope @ none:6 [46] eval(m::Module, e::Any) @ Core ./boot.jl:489 [47] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [48] _start() @ Base ./client.jl:550 17:37:53 | maxrss 2.4% | mem 2.4% | START (4/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (4/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [6] eval(m::Module, e::Any) @ Core ./boot.jl:489 [7] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1015 [inlined] [8] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [9] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1411 [10] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [11] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1014 [inlined] [12] macro expansion @ ./lock.jl:376 [inlined] [13] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:989 [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1120 [15] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [24] #521 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1165 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#521#522"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [27] cd(f::var"#with_test_package##2#with_test_package##3"{var"#521#522"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:107 [28] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#521#522"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:51 [29] with_test_package(f::var"#521#522"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [30] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1156 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1159 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1164 [inlined] [37] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [38] IncludeInto @ ./Base.jl:308 [inlined] [39] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [40] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [41] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [44] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [45] top-level scope @ none:6 [46] eval(m::Module, e::Any) @ Core ./boot.jl:489 [47] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [48] _start() @ Base ./client.jl:550 17:37:53 | maxrss 2.4% | mem 2.4% | START (5/9) test item "errors" at test/error_tests.jl:1 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (5/9) test item "errors" <0.1 secs (<0.1% compile), 26.62 K allocs (1.987 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#911"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#911"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:677 [inlined] Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2403 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2386 [4] require(into::Module, mod::Symbol) @ Base ./loading.jl:2362 [5] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] eval(m::Module, e::Any) @ Core ./boot.jl:489 [9] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [10] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [11] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [12] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [13] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [14] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [15] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [16] open @ ./io.jl:407 [inlined] [17] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [20] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [27] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [28] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [29] #521 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1165 [inlined] [30] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [31] activate(f::var"#with_test_package##4#with_test_package##5"{var"#521#522"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [32] cd(f::var"#with_test_package##2#with_test_package##3"{var"#521#522"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:107 [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#521#522"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:51 [34] with_test_package(f::var"#521#522"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [35] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1156 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1159 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1164 [inlined] [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [43] IncludeInto @ ./Base.jl:308 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 17:37:53 | maxrss 2.4% | mem 2.4% | START (6/9) test item "errors at the top level" at test/error_tests.jl:17 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (6/9) test item "errors at the top level" <0.1 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 [ Info: RUNNING Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [22] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [23] #521 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1165 [inlined] [24] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#with_test_package##4#with_test_package##5"{var"#521#522"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [26] cd(f::var"#with_test_package##2#with_test_package##3"{var"#521#522"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:107 [27] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#521#522"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:51 [28] with_test_package(f::var"#521#522"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [29] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1156 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1159 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1164 [inlined] [36] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [37] IncludeInto @ ./Base.jl:308 [inlined] [38] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [39] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [40] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [44] top-level scope @ none:6 [45] eval(m::Module, e::Any) @ Core ./boot.jl:489 [46] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [47] _start() @ Base ./client.jl:550 17:37:53 | maxrss 2.4% | mem 2.4% | START (7/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (7/9) test item "nonexistent test setup" <0.1 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ none:0 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #79 @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1154 [inlined] [4] with_source_path(f::ReTestItems.var"#79#80"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:977 [5] (::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1153 [6] redirect_stdio(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] _redirect_logs(f::ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:108 [8] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#77#78"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1151 [14] runtestitem @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:1073 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:378 [17] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:542 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:653 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:347 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [22] runtests @ ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:268 [inlined] [23] #521 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1165 [inlined] [24] #with_test_package##4 @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#with_test_package##4#with_test_package##5"{var"#521#522"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:1489 [26] cd(f::var"#with_test_package##2#with_test_package##3"{var"#521#522"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:107 [27] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#521#522"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/rFUty/test/_integration_test_tools.jl:51 [28] with_test_package(f::var"#521#522"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:30 [29] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1156 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1159 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1164 [inlined] [36] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [37] IncludeInto @ ./Base.jl:308 [inlined] [38] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:21 [39] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [40] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:15 [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/runtests.jl:17 [inlined] [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [44] top-level scope @ none:6 [45] eval(m::Module, e::Any) @ Core ./boot.jl:489 [46] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [47] _start() @ Base ./client.jl:550 17:37:53 | maxrss 2.4% | mem 2.4% | START (8/9) test item "failures" at test/failure_tests.jl:1 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (8/9) test item "failures" <0.1 secs (<0.1% compile), 3.36 K allocs (154.016 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.03901946217299907 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE 17:37:53 | maxrss 2.4% | mem 2.4% | START (9/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:37:53 | maxrss 2.4% | mem 2.4% | DONE (9/9) test item "do_thing Pass" <0.1 secs (<0.1% compile), 2.17 K allocs (104.768 KB) [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 0.6s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.0s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 0.1s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.0s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 0.1s UndefVarError | 2 2 0.0s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.0s errors at the top level | 1 1 2 0.0s nonexistent test setup | 1 1 0.0s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/rFUty/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1184. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1184 overwritten at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1215. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 806: [ Info: Starting test worker 1 on pid = 806, with 2 threads [ Info: Starting running test items Worker 806: 17:40:21 | maxrss 2.5% | mem 3.2% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 806: 17:40:22 | maxrss 2.5% | mem 3.2% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (97.0% compile), 23.26 K allocs (1.258 MB) Worker 806: 17:40:23 | maxrss 2.5% | mem 3.2% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 806: 17:40:23 | maxrss 2.5% | mem 3.2% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.45 K allocs (75.984 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 806 Error in testset "skip false, 1 pass, 1 fail" on worker 806: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_skip_tests.jl:8 Expression: false Worker 806: 17:40:25 | maxrss 2.5% | mem 3.2% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 806: 17:40:26 | maxrss 2.5% | mem 3.2% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 806: 17:40:26 | maxrss 2.5% | mem 3.2% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.45 K allocs (74.624 KB) Worker 806: 17:40:27 | maxrss 2.5% | mem 3.2% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 806: 17:40:28 | maxrss 2.5% | mem 3.2% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=806). Worker 806: [806] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1231 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 22.4s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1231 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_parse_error_test.jl 17:40:40 | maxrss 2.5% | mem 3.1% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/testfiles/_direct_testitem.jl:6 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] Test Summary: | Fail Total Time should fail | 1 1 6.1s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 826: [ Info: Starting test worker 2 on pid = 826, with 2 threads\n Worker 827: [ Info: Starting test worker 3 on pid = 827, with 2 threads\n Worker 824: [ Info: Starting test worker 1 on pid = 824, with 2 threads\n[ Info: Starting running test items\n Worker 826: [826] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x757f88485f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 827: [827] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x725c6fa45f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 824: [824] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x71b2c0cd2f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 824\n┌ Error: Worker(pid=824, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 827\n┌ Error: Worker(pid=827, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 826\n┌ Error: Worker(pid=826, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 845: [ Info: Starting test worker on pid = 845, with 2 threads\n Worker 851: [ Info: Starting test worker on pid = 851, with 2 threads\n Worker 847: [ Info: Starting test worker on pid = 847, with 2 threads\n Worker 845: [845] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7bdc77142f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 851: [851] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x75e9aa1c4f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 847: [847] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f7d19eeff14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 845\n┌ Error: Worker(pid=845, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=845, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 851\n┌ Error: Worker(pid=851, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=851, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 847\n┌ Error: Worker(pid=847, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 3 completed. Closing Worker(pid=847, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 873: [ Info: Starting test worker 1 on pid = 873, with 2 threads\n Worker 875: [ Info: Starting test worker 2 on pid = 875, with 2 threads\n Worker 876: [ Info: Starting test worker 3 on pid = 876, with 2 threads\n[ Info: Starting running test items\n Worker 875: [875] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7b31ee10ef14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 873: [873] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x795e720e7f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 876: [876] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x757319200f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 875\n┌ Error: Worker(pid=875, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 876\n┌ Error: Worker(pid=876, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 873\n┌ Error: Worker(pid=873, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 896: [ Info: Starting test worker on pid = 896, with 2 threads\n Worker 898: [ Info: Starting test worker on pid = 898, with 2 threads\n Worker 894: [ Info: Starting test worker on pid = 894, with 2 threads\n Worker 896: [896] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7dd00547bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 894: [894] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x77a6f0f02f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 898: [898] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e637ff1ef14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 896\n┌ Error: Worker(pid=896, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=896, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 894\n┌ Error: Worker(pid=894, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=894, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 898\n┌ Error: Worker(pid=898, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 1 completed. Closing Worker(pid=898, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 932: [ Info: Starting test worker 3 on pid = 932, with 2 threads\n Worker 929: [ Info: Starting test worker 1 on pid = 929, with 2 threads\n Worker 931: [ Info: Starting test worker 2 on pid = 931, with 2 threads\n[ Info: Starting running test items\n Worker 932: [932] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e287245cf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 931: [931] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x759a7123af14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 929: [929] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7a1673122f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 929\n┌ Error: Worker(pid=929, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 931\n┌ Error: Worker(pid=931, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 932\n┌ Error: Worker(pid=932, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 950: [ Info: Starting test worker on pid = 950, with 2 threads\n Worker 952: [ Info: Starting test worker on pid = 952, with 2 threads\n Worker 954: [ Info: Starting test worker on pid = 954, with 2 threads\n Worker 950: [950] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x73b1f3c5bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 952: [952] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x759cb2cdbf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 954: [954] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e4476478f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 950\n┌ Error: Worker(pid=950, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=950, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 952\n┌ Error: Worker(pid=952, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=952, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 954\n┌ Error: Worker(pid=954, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/rFUty/src/ReTestItems.jl:716\n[ Info: All tests on worker 3 completed. Closing Worker(pid=954, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1336 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1299 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1301 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/rFUty/test/integrationtests.jl:1327 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 17:47:56 | maxrss 2.5% | mem 2.5% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 17:47:56 | maxrss 2.5% | mem 2.5% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 15 Error in testset "test set" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 17:47:58 | maxrss 2.5% | mem 2.5% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 17:47:58 | maxrss 2.5% | mem 2.5% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 15 Error in testset "Failure at toplevel" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 17:47:58 | maxrss 2.5% | mem 2.5% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 17:47:59 | maxrss 2.5% | mem 2.5% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 15 Error in testset "Bar" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/rFUty/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 task_done_hook at ./task.jl:868 jfptr_task_done_hook_59255.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_finish_task at /source/src/task.c:341 start_task at /source/src/task.c:1263 unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.12/Profile/src/Profile.jl:1361 Overhead ╎ [+additional indent] Count File:Line Function ========================================================= Thread 1 (default) Task 0x00007b02bab79d20 Total snapshots: 338. Utilization: 0% ╎338 @Base/task.jl:868 task_done_hook(t::Task) ╎ 338 @Base/task.jl:1228 wait() 337╎ 338 @Base/task.jl:1216 poptask(W::Base.IntrusiveLinkedListSynchronized{T… [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 _trywait at ./asyncevent.jl:163 profile_printing_listener at ./Base.jl:332 #start_profile_listener##0 at ./Base.jl:352 jfptr_YY.start_profile_listenerYY.YY.0_9934.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) Allocations: 11300625 (Pool: 11300497; Big: 128); GC: 9 PkgEval terminated after 2741.71s: test duration exceeded the time limit