Package evaluation of ReTestItems on Julia 1.11.4 (a71dd056e0*) started at 2025-04-08T07:57:45.378 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.46s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [817f1d60] + ReTestItems v1.31.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [817f1d60] + ReTestItems v1.31.0 [1e6cf692] + TestEnv v1.102.0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 1.2s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 16.07s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_zQ3qe3/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.0 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_zQ3qe3/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.1 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.0 [bac558e1] OrderedCollections v1.8.0 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.0 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Worker 23: [23] signal 15: Terminated Worker 27: [27] signal 15: Terminated in expression starting at none:1 syscall at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) Worker 35: [35] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:125 07:59:49 | maxrss 1.3% | mem 1.4% | SKIP (0/1) test item "skip" at internals.jl:288 07:59:54 | maxrss 1.4% | mem 1.4% | START test item "TI1" at macros.jl:32 07:59:54 | maxrss 1.4% | mem 1.4% | DONE test item "TI1" 0.1 secs (95.8% compile), 69.46 K allocs (3.900 MB) 07:59:55 | maxrss 1.4% | mem 1.4% | START test item "TI2" at macros.jl:43 07:59:55 | maxrss 1.4% | mem 1.4% | DONE test item "TI2" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 07:59:55 | maxrss 1.4% | mem 1.4% | START test item "TI" at macros.jl:53 07:59:55 | maxrss 1.4% | mem 1.4% | DONE test item "TI" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 07:59:55 | maxrss 1.4% | mem 1.4% | START test item "macro-import" at macros.jl:64 07:59:57 | maxrss 1.4% | mem 1.4% | DONE test item "macro-import" 2.5 secs (99.4% compile), 821.49 K allocs (44.694 MB) 07:59:58 | maxrss 1.4% | mem 1.4% | START test item "Foo" at macros.jl:95 07:59:58 | maxrss 1.4% | mem 1.4% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.79 K allocs (135.256 KB) 07:59:58 | maxrss 1.4% | mem 1.4% | START test item "Foo3" at macros.jl:110 07:59:58 | maxrss 1.4% | mem 1.4% | DONE test item "Foo3" <0.1 secs (54.4% compile), 2.94 K allocs (144.744 KB) 07:59:59 | maxrss 1.4% | mem 1.4% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:109 [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [7] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [8] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [9] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1007 [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:123 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:118 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:23 [15] include @ ./sysimg.jl:38 [inlined] [16] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:20 [17] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [18] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [20] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [21] include(fname::String) @ Main ./sysimg.jl:38 [22] top-level scope @ none:6 [23] eval @ ./boot.jl:430 [inlined] [24] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [25] _start() @ Base ./client.jl:531 08:00:02 | maxrss 1.6% | mem 1.6% | DONE test item "Foo4" 08:00:02 | maxrss 1.6% | mem 1.6% | START test item "testitem active" at macros.jl:138 08:00:02 | maxrss 1.6% | mem 1.6% | DONE test item "testitem active" <0.1 secs (85.6% compile), 3.28 K allocs (168.192 KB) 08:00:02 | maxrss 1.6% | mem 1.6% | START test item "run" at macros.jl:146 08:00:02 | maxrss 1.6% | mem 1.6% | DONE test item "run" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 08:00:03 | maxrss 1.6% | mem 1.6% | START test item "comparisons" at macros.jl:182 08:00:04 | maxrss 1.6% | mem 1.6% | DONE test item "comparisons" 0.2 secs (86.1% compile), 30.07 K allocs (1.779 MB) 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa bool" at macros.jl:306 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "test contains error" at macros.jl:314 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 1" at macros.jl:335 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 2" at macros.jl:345 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr loads module" at macros.jl:362 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 08:00:11 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 08:00:11 | maxrss 1.6% | mem 1.6% | START test item "default_imports" at macros.jl:424 08:00:11 | maxrss 1.6% | mem 1.6% | DONE test item "default_imports" <0.1 secs (58.7% compile), 1.96 K allocs (95.024 KB) 08:00:11 | maxrss 1.6% | mem 1.6% | START test item "no_default_imports" at macros.jl:432 08:00:12 | maxrss 1.6% | mem 1.6% | DONE test item "no_default_imports" 0.1 secs (96.6% compile), 297.41 K allocs (16.684 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` Updating `~/.julia/packages/ReTestItems/Q6zs8/Project.toml` [1e6cf692] + TestEnv v1.102.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/Q6zs8/Manifest.toml` [1e6cf692] + TestEnv v1.102.0 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:00:47 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 08:00:47 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.88 K allocs (101.288 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:00:47 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 08:00:47 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.328 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:00:47 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 08:00:48 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.328 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` 08:00:51 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at src/foo_test.jl:1 08:00:51 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" 0.7 secs (3.5% compile), 54.42 K allocs (6.587 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 15 08:00:52 | maxrss 1.8% | mem 1.8% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 08:00:52 | maxrss 1.8% | mem 1.8% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:00:52 | maxrss 1.8% | mem 1.8% | START (7/8) test item "bar" at src/bar_tests.jl:1 08:00:53 | maxrss 1.8% | mem 1.8% | DONE (7/8) test item "bar" 0.7 secs (97.4% compile), 329.89 K allocs (15.701 MB) 08:00:53 | maxrss 1.8% | mem 1.8% | START (8/8) test item "foo" at src/foo_test.jl:1 08:00:53 | maxrss 1.8% | mem 1.8% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (108.496 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.01 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.04 seconds. Scheduling 1 tests on pid 15 08:00:56 | maxrss 1.8% | mem 1.8% | START (1/1) test item "bar" at src/bar_tests.jl:1 08:00:56 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.05 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.13 seconds. Scheduling 1 tests on pid 15 08:00:59 | maxrss 1.8% | mem 1.8% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 08:00:59 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.13 seconds. Scheduling 1 tests on pid 15 08:01:00 | maxrss 1.8% | mem 1.8% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 08:01:00 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.22 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.12 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 5 tests on pid 15 08:01:05 | maxrss 1.8% | mem 1.9% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 08:01:05 | maxrss 1.8% | mem 1.9% | DONE (1/5) test item "scope test - loops" <0.1 secs (74.3% compile), 4.12 K allocs (212.256 KB) 08:01:05 | maxrss 1.8% | mem 1.9% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 08:01:06 | maxrss 1.8% | mem 1.9% | DONE (2/5) test item "scope test - setups" <0.1 secs (78.4% compile), 4.37 K allocs (226.496 KB) 08:01:06 | maxrss 1.8% | mem 1.9% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 08:01:06 | maxrss 1.8% | mem 1.9% | DONE (3/5) test item "scope test - testsets" <0.1 secs (63.5% compile), 5.09 K allocs (250.288 KB) 08:01:06 | maxrss 1.8% | mem 1.9% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 08:01:06 | maxrss 1.8% | mem 1.9% | DONE (4/5) test item "scope test - imports" <0.1 secs (72.2% compile), 8.48 K allocs (411.376 KB) 08:01:06 | maxrss 1.8% | mem 1.9% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 08:01:06 | maxrss 1.8% | mem 1.9% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.71 K allocs (127.424 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/Manifest.toml:0 Testing NoDeps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_G1Co2O/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test v1.11.0 Status `/tmp/jl_G1Co2O/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.28 seconds. Scheduling 2 tests on pid 57 08:01:32 | maxrss 1.9% | mem 2.6% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 08:01:32 | maxrss 1.9% | mem 2.6% | DONE (1/2) test item "toplevel" 0.2 secs (95.1% compile), 30.02 K allocs (1.593 MB) 08:01:33 | maxrss 1.9% | mem 2.6% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 08:01:33 | maxrss 1.9% | mem 2.6% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.3% compile), 40.76 K allocs (2.315 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 57 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.6s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.1s Testing NoDeps tests passed Testing TestsInSrc ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_6p0H5i/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_6p0H5i/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.0 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.42 seconds. Scheduling 8 tests on pid 61 08:01:56 | maxrss 1.9% | mem 2.7% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 08:01:56 | maxrss 1.9% | mem 2.7% | DONE (1/8) test item "a1" 0.2 secs (94.9% compile), 30.60 K allocs (1.645 MB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 08:01:57 | maxrss 1.9% | mem 2.7% | DONE (2/8) test item "a2" 0.2 secs (92.7% compile), 39.68 K allocs (2.262 MB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 08:01:57 | maxrss 1.9% | mem 2.7% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 08:01:57 | maxrss 1.9% | mem 2.7% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 08:01:57 | maxrss 1.9% | mem 2.7% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 08:01:57 | maxrss 1.9% | mem 2.7% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 08:01:57 | maxrss 1.9% | mem 2.7% | START (7/8) test item "bar" at src/bar_tests.jl:1 08:01:58 | maxrss 1.9% | mem 2.7% | DONE (7/8) test item "bar" 0.7 secs (97.2% compile), 332.20 K allocs (15.811 MB) 08:01:58 | maxrss 1.9% | mem 2.7% | START (8/8) test item "foo" at src/foo_test.jl:1 08:01:58 | maxrss 1.9% | mem 2.7% | DONE (8/8) test item "foo" <0.1 secs (73.1% compile), 3.69 K allocs (178.888 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.5s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.1s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.7s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed Testing TestProjectFile ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_YKes5p/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_YKes5p/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.1 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.0 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling TestProjectFile... 808.9 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.3 seconds. Scheduling 1 tests on pid 65 08:02:22 | maxrss 1.9% | mem 2.6% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 08:02:25 | maxrss 1.9% | mem 2.8% | DONE (1/1) test item "TestProjectFile" 2.6 secs (36.8% compile, 10.5% recompile, 1.4% GC), 349.21 K allocs (21.265 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 65 Precompiling InlineStrings... 1310.5 ms ✓ InlineStrings 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 5.8s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.6s test-only dep on InlineStrings | 1 1 2.2s Testing TestProjectFile tests passed Testing TestEndExpr Status `/tmp/jl_K8zTTU/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_K8zTTU/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling ReTestItems... 3442.1 ms ✓ TestEnv 5215.5 ms ✓ ReTestItems 2 dependencies successfully precompiled in 9 seconds. 26 already precompiled. Precompiling TestEndExpr... 636.2 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.39 seconds. Scheduling 2 tests on pid 77 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 93: [ Info: Starting test worker 1 on pid = 93, with 2 threads [ Info: Starting running test items Worker 93: 08:03:24 | maxrss 1.4% | mem 3.5% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 93: 08:03:25 | maxrss 1.4% | mem 3.5% | DONE (1/2) test item "correct usage" 0.3 secs (96.8% compile), 61.76 K allocs (3.222 MB) Worker 93: 08:03:25 | maxrss 1.4% | mem 3.5% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 93: 08:03:25 | maxrss 1.4% | mem 3.5% | DONE (2/2) test item "incorrect usage" <0.1 secs (70.6% compile), 2.81 K allocs (144.776 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=93). Worker 93: [93] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 30.4s Testing TestEndExpr tests passed Testing DontPass ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_BFe1KH/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [37e2e46d] LinearAlgebra v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_BFe1KH/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Precompiling DontPass... 725.3 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.44 seconds. Scheduling 9 tests on pid 98 08:03:52 | maxrss 1.9% | mem 2.8% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 08:03:53 | maxrss 1.9% | mem 2.8% | DONE (1/9) test item "do_thing Pass" 0.7 secs (98.6% compile), 302.67 K allocs (14.268 MB) 08:03:54 | maxrss 1.9% | mem 2.8% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 08:03:55 | maxrss 1.9% | mem 2.8% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.1% compile), 115.03 K allocs (6.585 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 98 Error in testset "do_thing Fail" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.21785190052581616, 0.7589621875651773, 0.34779431033819486] == 1 08:03:55 | maxrss 1.9% | mem 2.8% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 08:04:05 | maxrss 1.9% | mem 3.0% | DONE (3/9) test item "do_thing Error" 9.2 secs (91.0% compile, 0.8% GC), 5.71 M allocs (335.365 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 98 Error in testset "do_thing Error" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 08:04:05 | maxrss 1.9% | mem 3.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 08:04:05 | maxrss 1.9% | mem 3.0% | DONE (4/9) test item "bad setup, good test" 0.7 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 98 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 98 Error in testset "bad setup, good test" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 [31] eval @ ./boot.jl:430 [inlined] [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [33] _start() @ Base ./client.jl:531 08:04:05 | maxrss 1.9% | mem 3.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 08:04:06 | maxrss 1.9% | mem 3.0% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 98 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 98 Error in testset "bad setup, bad test" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 [31] eval @ ./boot.jl:430 [inlined] [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [33] _start() @ Base ./client.jl:531 08:04:06 | maxrss 1.9% | mem 3.0% | START (6/9) test item "errors" at test/error_tests.jl:1 08:04:07 | maxrss 1.9% | mem 3.0% | DONE (6/9) test item "errors" 1.5 secs (47.8% compile), 160.16 K allocs (9.391 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 98 Error in testset "UndefVarError" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#248"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#248"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [26] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [32] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [33] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [34] include(fname::String) @ Main ./sysimg.jl:38 [35] top-level scope @ none:6 [36] eval @ ./boot.jl:430 [inlined] [37] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [38] _start() @ Base ./client.jl:531 08:04:07 | maxrss 1.9% | mem 3.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 08:04:08 | maxrss 1.9% | mem 3.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 98 Error in testset "errors at the top level" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [18] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [24] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(fname::String) @ Main ./sysimg.jl:38 [27] top-level scope @ none:6 [28] eval @ ./boot.jl:430 [inlined] [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [30] _start() @ Base ./client.jl:531 08:04:08 | maxrss 1.9% | mem 3.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 08:04:08 | maxrss 1.9% | mem 3.0% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 98 Error in testset "nonexistent test setup" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [17] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [23] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(fname::String) @ Main ./sysimg.jl:38 [26] top-level scope @ none:6 [27] eval @ ./boot.jl:430 [inlined] [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [29] _start() @ Base ./client.jl:531 08:04:08 | maxrss 1.9% | mem 3.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 08:04:08 | maxrss 1.9% | mem 3.0% | DONE (9/9) test item "failures" <0.1 secs (81.8% compile), 12.18 K allocs (597.888 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 98 Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.02204176765013102 < 0 Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 19.5s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.4s do_thing Error | 1 1 9.2s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.7s bad setup, bad test | 1 1 0.3s test/error_tests.jl | 1 6 7 errors | 4 4 1.8s UndefVarError | 2 2 0.8s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.5s errors at the top level | 1 1 2 0.4s nonexistent test setup | 1 1 0.2s test/failure_tests.jl | 3 3 failures | 3 3 0.1s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 15 08:04:10 | maxrss 1.9% | mem 2.0% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 08:04:10 | maxrss 1.9% | mem 2.0% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.62 K allocs (84.560 KB) 08:04:10 | maxrss 1.9% | mem 2.0% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 08:04:10 | maxrss 1.9% | mem 2.0% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.73 K allocs (128.000 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 8 tests on pid 15 08:04:11 | maxrss 1.9% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 08:04:11 | maxrss 1.9% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 08:04:11 | maxrss 1.9% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.11/activate_set.jl:63 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:04:11 | maxrss 1.9% | mem 2.0% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 08:04:12 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "TestProjectFile" 0.8 secs (69.0% compile, 33.4% recompile, 2.1% GC), 247.40 K allocs (14.192 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.11/activate_set.jl:63 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 9 tests on pid 15 08:04:15 | maxrss 2.0% | mem 2.1% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 08:04:15 | maxrss 2.0% | mem 2.1% | DONE (1/9) test item "do_thing Pass" <0.1 secs (71.0% compile), 13.20 K allocs (712.696 KB) 08:04:15 | maxrss 2.0% | mem 2.1% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 08:04:15 | maxrss 2.0% | mem 2.1% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.2% compile), 116.03 K allocs (6.639 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.9150201548329495, 0.18813478903038716, 0.9068197943066979] == 1 08:04:16 | maxrss 2.0% | mem 2.1% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 08:04:17 | maxrss 2.0% | mem 2.1% | DONE (3/9) test item "do_thing Error" 1.6 secs (52.5% compile, 2.3% GC), 986.69 K allocs (64.049 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 08:04:17 | maxrss 2.0% | mem 2.1% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 08:04:18 | maxrss 2.0% | mem 2.1% | DONE (4/9) test item "bad setup, good test" 0.6 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 [52] top-level scope @ none:6 [53] eval @ ./boot.jl:430 [inlined] [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:04:18 | maxrss 2.0% | mem 2.1% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 08:04:18 | maxrss 2.0% | mem 2.1% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 [52] top-level scope @ none:6 [53] eval @ ./boot.jl:430 [inlined] [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:04:18 | maxrss 2.0% | mem 2.1% | START (6/9) test item "errors" at test/error_tests.jl:1 08:04:19 | maxrss 2.0% | mem 2.1% | DONE (6/9) test item "errors" 1.2 secs (15.0% compile), 44.07 K allocs (2.951 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#463"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#463"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [31] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [32] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [33] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [34] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [36] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [41] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] --- the above 2 lines are repeated 1 more time --- [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [50] include @ ./sysimg.jl:38 [inlined] [51] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [52] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [55] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [56] include(fname::String) @ Main ./sysimg.jl:38 [57] top-level scope @ none:6 [58] eval @ ./boot.jl:430 [inlined] [59] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:04:19 | maxrss 2.0% | mem 2.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 08:04:20 | maxrss 2.0% | mem 2.1% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [24] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [25] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [26] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [28] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [33] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] --- the above 2 lines are repeated 1 more time --- [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [41] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [42] include @ ./sysimg.jl:38 [inlined] [43] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [44] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [47] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [48] include(fname::String) @ Main ./sysimg.jl:38 [49] top-level scope @ none:6 [50] eval @ ./boot.jl:430 [inlined] [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:04:20 | maxrss 2.0% | mem 2.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 08:04:20 | maxrss 2.0% | mem 2.1% | DONE (8/9) test item "nonexistent test setup" 0.3 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [32] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] --- the above 2 lines are repeated 1 more time --- [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 [49] eval @ ./boot.jl:430 [inlined] [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:04:20 | maxrss 2.0% | mem 2.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 08:04:20 | maxrss 2.0% | mem 2.1% | DONE (9/9) test item "failures" <0.1 secs (81.7% compile), 12.29 K allocs (605.200 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.36952814671863954 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.11/activate_set.jl:63 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:07 | maxrss 2.1% | mem 2.1% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 08:10:10 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "MonoRepo tests" 2.5 secs (<0.1% compile, 0.3% GC), 64.79 K allocs (7.742 MB) [ Tests Completed: 1/1 test items were run. Testing C ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1920 Status `/tmp/jl_ckBzku/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test v1.11.0 Status `/tmp/jl_ckBzku/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.07 seconds. Scheduling 1 tests on pid 187 08:10:32 | maxrss 2.1% | mem 2.9% | START (1/1) test item "C_tests" at test/c_tests.jl:1 08:10:33 | maxrss 2.1% | mem 2.9% | DONE (1/1) test item "C_tests" 0.2 secs (95.2% compile), 43.29 K allocs (2.362 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 3.6s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.2s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/tgnBf/src/julia-1.11/activate_set.jl:63 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:34 | maxrss 2.1% | mem 2.1% | START (1/1) test item "C_tests" at test/c_tests.jl:1 08:10:34 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 2.28 K allocs (115.064 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:34 | maxrss 2.1% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 08:10:34 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:36 | maxrss 2.1% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 08:10:36 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:36 | maxrss 2.1% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 08:10:36 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 15 08:10:36 | maxrss 2.1% | mem 2.1% | START (1/2) test item "bar" at src/bar_tests.jl:1 08:10:36 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 08:10:36 | maxrss 2.1% | mem 2.1% | START (2/2) test item "foo" at src/foo_test.jl:1 08:10:36 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.05 seconds. Scheduling 1 tests on pid 15 08:10:38 | maxrss 2.1% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 15 08:10:38 | maxrss 2.1% | mem 2.1% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (7/8) test item "bar" at src/bar_tests.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 08:10:38 | maxrss 2.1% | mem 2.1% | START (8/8) test item "foo" at src/foo_test.jl:1 08:10:38 | maxrss 2.1% | mem 2.1% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 15 08:10:39 | maxrss 2.1% | mem 2.1% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (7/8) test item "bar" at src/bar_tests.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 08:10:39 | maxrss 2.1% | mem 2.1% | START (8/8) test item "foo" at src/foo_test.jl:1 08:10:39 | maxrss 2.1% | mem 2.1% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 3 tests on pid 15 08:10:41 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:41 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:10:41 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:41 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:41 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:41 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. Scheduling 2 tests on pid 15 08:10:43 | maxrss 2.1% | mem 2.1% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:43 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:43 | maxrss 2.1% | mem 2.1% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:43 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.16 seconds. Scheduling 2 tests on pid 15 08:10:45 | maxrss 2.1% | mem 2.1% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:45 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:45 | maxrss 2.1% | mem 2.1% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:45 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:10:45 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:45 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:10:45 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:45 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.36 seconds. Scheduling 1 tests on pid 15 08:10:47 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:47 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:10:48 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:48 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:10:48 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:48 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:48 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:48 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:10:49 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:49 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. Scheduling 1 tests on pid 15 08:10:51 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:51 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.98 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:10:53 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:10:53 | maxrss 2.1% | mem 2.1% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:10:53 | maxrss 2.1% | mem 2.1% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:10:53 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:10:53 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:10:53 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.01 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. Scheduling 3 tests on pid 15 08:11:00 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:11:00 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:11:00 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:11:00 | maxrss 2.1% | mem 2.1% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:11:00 | maxrss 2.1% | mem 2.1% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 08:11:00 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:11:00 | maxrss 2.1% | mem 2.1% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:11:00 | maxrss 2.1% | mem 2.1% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:11:00 | maxrss 2.1% | mem 2.1% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:11:00 | maxrss 2.1% | mem 2.1% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:00 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.98 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.97 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.98 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.07 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.07 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.97 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. Scheduling 3 tests on pid 15 08:11:12 | maxrss 2.1% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 08:11:12 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 08:11:12 | maxrss 2.1% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 08:11:12 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 08:11:12 | maxrss 2.1% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 08:11:12 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. 08:11:12 | maxrss 2.1% | mem 2.2% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 08:11:12 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 5.55 K allocs (239.560 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 191: [ Info: Starting test worker 1 on pid = 191, with 2 threads\n[ Info: Starting running test items\n Worker 191: 08:11:29 | maxrss 2.1% | mem 2.9% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 191: 08:11:34 | maxrss 2.1% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 3.0 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:430 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n Worker 191: 08:11:35 | maxrss 2.1% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 191: 08:11:35 | maxrss 2.1% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:430 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=191).\n Worker 191: [191] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 191: [ Info: Starting test worker 1 on pid = 191, with 2 threads\n[ Info: Starting running test items\n Worker 191: 08:11:29 | maxrss 2.1% | mem 2.9% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 191: 08:11:34 | maxrss 2.1% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 3.0 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:430 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n Worker 191: 08:11:35 | maxrss 2.1% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 191: 08:11:35 | maxrss 2.1% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:430 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=191).\n Worker 191: [191] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 206: [ Info: Starting test worker 1 on pid = 206, with 2 threads [ Info: Starting running test items Worker 206: 08:12:27 | maxrss 2.1% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 206: 08:12:29 | maxrss 2.1% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (93.1% compile), 6.92 K allocs (344.592 KB) Worker 206: [206] signal 15: Terminated in expression starting at none:1 _ZNK4llvm11Instruction13getAAMetadataEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm14MemoryLocation3getEPKNS_8LoadInstE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 206 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 206 ┌ Error: Worker(pid=206, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 211: [ Info: Starting test worker on pid = 211, with 2 threads Worker 211: 08:12:45 | maxrss 2.1% | mem 2.9% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 211: [211] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 211 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 211 ┌ Error: Worker(pid=211, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 216: [ Info: Starting test worker on pid = 216, with 2 threads Worker 216: 08:13:01 | maxrss 2.1% | mem 2.9% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 216: [216] signal 15: Terminated in expression starting at none:1 _ZNK4llvm5APInt7compareERKS0_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 216 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 216 ┌ Error: Worker(pid=216, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 221: [ Info: Starting test worker on pid = 221, with 2 threads Worker 221: 08:13:17 | maxrss 2.1% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 221 [221] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZNK4llvm12DenseMapBaseINS_8DenseMapIPNS_10BasicBlockENS_14DomTreeBuilder11SemiNCAInfoINS_17DominatorTreeBaseIS2_Lb0EEEE7InfoRecENS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_S9_EEEES3_S9_SB_SE_E15LookupBucketForIS3_EEbRKT_RPKSE_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_10BasicBlockENS_14DomTreeBuilder11SemiNCAInfoINS_17DominatorTreeBaseIS2_Lb0EEEE7InfoRecENS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_S9_EEEES3_S9_SB_SE_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=221, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 226: [ Info: Starting test worker on pid = 226, with 2 threads Worker 226: 08:13:33 | maxrss 2.1% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 226 [226] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZN4llvm14SparseMultiSetINS_13PhysRegSUOperENS_8identityIjEEtE8eraseAllERKj.isra.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0x75ed413dfd47) unknown function (ip: 0x2300000007) unknown function (ip: 0x75ed4151846f) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 ┌ Error: Worker(pid=226, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 231: [ Info: Starting test worker on pid = 231, with 2 threads Worker 231: 08:13:50 | maxrss 2.1% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 231 [231] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZL17getPreferredRangeRKN4llvm13ConstantRangeES2_NS0_18PreferredRangeTypeE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZNK4llvm13ConstantRange13intersectWithERKS0_NS0_18PreferredRangeTypeE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution11getRangeRefEPKNS_4SCEVENS0_13RangeSignHintEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution33isKnownPredicateViaConstantRangesENS_7CmpInst9PredicateEPKNS_4SCEVES5_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution31isKnownViaNonRecursiveReasoningENS_7CmpInst9PredicateEPKNS_4SCEVES5_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution16isKnownPredicateENS_7CmpInst9PredicateEPKNS_4SCEVES5_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution17evaluatePredicateENS_7CmpInst9PredicateEPKNS_4SCEVES5_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16computePeelCountEPNS_4LoopEjRNS_19TargetTransformInfo18PeelingPreferencesEjRNS_13DominatorTreeERNS_15ScalarEvolutionEPNS_15AssumptionCacheEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm18computeUnrollCountEPNS_4LoopERKNS_19TargetTransformInfoERNS_13DominatorTreeEPNS_8LoopInfoEPNS_15AssumptionCacheERNS_15ScalarEvolutionERKNS_15SmallPtrSetImplIPKNS_5ValueEEEPNS_25OptimizationRemarkEmitterEjjbjjRNS2_20UnrollingPreferencesERNS2_18PeelingPreferencesERb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZL15tryToUnrollLoopPN4llvm4LoopERNS_13DominatorTreeEPNS_8LoopInfoERNS_15ScalarEvolutionERKNS_19TargetTransformInfoERNS_15AssumptionCacheERNS_25OptimizationRemarkEmitterEPNS_18BlockFrequencyInfoEPNS_18ProfileSummaryInfoEbibbSt8optionalIjESK_SJ_IbESL_SL_SL_SL_SK_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm18LoopFullUnrollPass3runERNS_4LoopERNS_15AnalysisManagerIS1_JRNS_27LoopStandardAnalysisResultsEEEES5_RNS_10LPMUpdaterE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=231, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 236: [ Info: Starting test worker on pid = 236, with 2 threads Worker 236: 08:14:07 | maxrss 2.1% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 236: [236] signal 15: Terminated in expression starting at none:1 _ZNK4llvm9Attribute16getAllocSizeArgsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZNK4llvm12AttributeSet16getAllocSizeArgsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 236 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 236 ┌ Error: Worker(pid=236, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 241: [ Info: Starting test worker on pid = 241, with 2 threads Worker 241: 08:14:23 | maxrss 2.1% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 241: [241] signal 15: Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 241 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 241 ┌ Error: Worker(pid=241, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 246: [ Info: Starting test worker on pid = 246, with 2 threads Worker 246: 08:14:39 | maxrss 2.1% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 246: [246] signal 15: Terminated in expression starting at none:1 _ZN4llvm18ScheduleDAGSDNodes15BuildSchedUnitsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm18ScheduleDAGSDNodes15BuildSchedGraphEPNS_9AAResultsE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 246 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 246 ┌ Error: Worker(pid=246, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 251: [ Info: Starting test worker on pid = 251, with 2 threads Worker 251: 08:14:55 | maxrss 2.1% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 251: [251] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 251 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 251 ┌ Error: Worker(pid=251, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 256: [ Info: Starting test worker on pid = 256, with 2 threads Worker 256: 08:15:10 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 256: 08:15:12 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.4% compile), 6.83 K allocs (341.032 KB) Worker 256: [256] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 256 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 256 ┌ Error: Worker(pid=256, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 261: [ Info: Starting test worker on pid = 261, with 2 threads Worker 261: 08:15:27 | maxrss 2.1% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 261: 08:15:28 | maxrss 2.1% | mem 2.9% | DONE (4/6) test item "Has retries=1 and always fails" 0.1 secs (93.4% compile), 6.83 K allocs (341.032 KB) Worker 261: [261] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 261 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 261 ┌ Error: Worker(pid=261, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 266: [ Info: Starting test worker on pid = 266, with 2 threads Worker 266: 08:15:43 | maxrss 2.1% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 266: [266] signal 15: Terminated in expression starting at none:1 _ZN4llvm15MachineFunction13handleRemovalERNS_12MachineInstrE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 266 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 266 ┌ Error: Worker(pid=266, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 271: [ Info: Starting test worker on pid = 271, with 2 threads Worker 271: 08:15:59 | maxrss 2.1% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 271: [271] signal 15: Terminated in expression starting at none:1 _ZN4llvm13LiveRangeCalc16findReachingDefsERNS_9LiveRangeERNS_17MachineBasicBlockENS_9SlotIndexEjNS_8ArrayRefIS5_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13LiveRangeCalc6extendERNS_9LiveRangeENS_9SlotIndexEjNS_8ArrayRefIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16LiveIntervalCalc12extendToUsesERNS_9LiveRangeENS_8RegisterENS_11LaneBitmaskEPNS_12LiveIntervalE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13LiveIntervals22computeVirtRegIntervalERNS_12LiveIntervalE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 271 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 271 ┌ Error: Worker(pid=271, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 276: [ Info: Starting test worker on pid = 276, with 2 threads Worker 276: 08:16:15 | maxrss 2.1% | mem 2.9% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 276 [276] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x77c829ef5f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=276, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 281: [ Info: Starting test worker on pid = 281, with 2 threads Worker 281: 08:16:30 | maxrss 2.1% | mem 2.9% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 281 [281] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x716f00562f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=281, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 286: [ Info: Starting test worker on pid = 286, with 2 threads Worker 286: 08:16:47 | maxrss 2.1% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 286 [286] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x722982114f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=286, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 291: [ Info: Starting test worker on pid = 291, with 2 threads Worker 291: 08:17:02 | maxrss 2.1% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 291 [291] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x7629a1c83f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=291, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 296: [ Info: Starting test worker on pid = 296, with 2 threads Worker 296: 08:17:18 | maxrss 2.1% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 296: 08:17:18 | maxrss 2.1% | mem 3.0% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (94.5% compile), 101.10 K allocs (5.361 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=296). Worker 296: [296] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 301: [ Info: Starting test worker 1 on pid = 301, with 2 threads [ Info: Starting running test items Worker 301: 08:17:35 | maxrss 2.1% | mem 2.9% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 301 [301] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7b0407159f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=301, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 306: [ Info: Starting test worker on pid = 306, with 2 threads Worker 306: 08:17:50 | maxrss 2.1% | mem 2.9% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 306: 08:17:50 | maxrss 2.1% | mem 2.9% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (93.4% compile), 21.12 K allocs (1.119 MB) Worker 306: [306] signal 15: Terminated in expression starting at none:1 _ZNK4llvm14TargetLowering17getConstraintTypeENS_9StringRefE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm19SelectionDAGBuilder14visitInlineAsmERKNS_8CallBaseEPKNS_10BasicBlockE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm19SelectionDAGBuilder5visitERKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel16SelectBasicBlockENS_14ilist_iteratorINS_12ilist_detail12node_optionsINS_11InstructionELb1ELb0EvEELb0ELb1EEES6_Rb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 306 ┌ Error: Worker(pid=306, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=306, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=306, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:766 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:776 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 [16] eval @ ./boot.jl:430 [inlined] [17] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [18] _start() @ Base ./client.jl:531 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 311: [ Info: Starting test worker 1 on pid = 311, with 2 threads [ Info: Starting running test items Worker 311: 08:18:06 | maxrss 2.1% | mem 2.9% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 311 [311] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x77a60294cf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=311, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 316: [ Info: Starting test worker on pid = 316, with 2 threads Worker 316: 08:18:21 | maxrss 2.1% | mem 2.9% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 316: 08:18:21 | maxrss 2.1% | mem 2.9% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (93.5% compile), 21.12 K allocs (1.119 MB) Worker 316: [316] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 316 ┌ Error: Worker(pid=316, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=316, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=316, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:786 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:798 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 [16] eval @ ./boot.jl:430 [inlined] [17] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [18] _start() @ Base ./client.jl:531 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 321: [ Info: Starting test worker 1 on pid = 321, with 2 threads [ Info: Starting running test items Worker 321: 08:18:36 | maxrss 2.1% | mem 2.9% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 321 [321] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7e212dc8af14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7e212c7cf095) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#835 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#463 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x7e212c7cd71e) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 ┌ Error: Worker(pid=321, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=321, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 326: [ Info: Starting test worker 1 on pid = 326, with 2 threads [ Info: Starting running test items Worker 326: 08:18:53 | maxrss 2.1% | mem 2.9% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 326 [326] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7c7544a90f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7c7543605085) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#835 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#463 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x7c754360370e) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 ┌ Error: Worker(pid=326, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=326, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 331: [ Info: Starting test worker 1 on pid = 331, with 2 threads [ Info: Starting running test items Worker 331: 08:19:10 | maxrss 2.1% | mem 2.9% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 331 [331] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7a334e1edf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7a334cd3a035) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#835 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#463 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x7a334cd386be) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 unknown function (ip: 0x7a334cd18b6a) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 ┌ Error: Worker(pid=331, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=331, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 341: [ Info: Starting test worker 1 on pid = 341, with 3,2 threads [ Info: Starting running test items Worker 341: 08:19:44 | maxrss 2.1% | mem 2.9% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 341: 08:19:44 | maxrss 2.1% | mem 2.9% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (94.2% compile), 27.53 K allocs (1.437 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=341). Worker 341: [341] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:874 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:908. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.07 seconds. Scheduling 3 tests on pid 15 08:19:48 | maxrss 2.1% | mem 2.2% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.840 KB) 08:19:48 | maxrss 2.1% | mem 2.2% | START (2/3) test item "other A" at test/integrationtests.jl:900 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) 08:19:48 | maxrss 2.1% | mem 2.2% | START (3/3) test item "other B" at test/integrationtests.jl:900 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:19:48 | maxrss 2.1% | mem 2.2% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.840 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:19:48 | maxrss 2.1% | mem 2.2% | START (1/2) test item "other A" at test/integrationtests.jl:900 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) 08:19:48 | maxrss 2.1% | mem 2.2% | START (2/2) test item "other B" at test/integrationtests.jl:900 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:19:48 | maxrss 2.1% | mem 2.2% | START (1/1) test item "other B" at test/integrationtests.jl:900 08:19:48 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.63 seconds. Scheduling 0 tests on pid 15 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:19:50 | maxrss 2.1% | mem 2.2% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 08:19:50 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.736 KB) 08:19:50 | maxrss 2.1% | mem 2.2% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 08:19:50 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.736 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 349: [ Info: Starting test worker 1 on pid = 349, with 2 threads [ Info: Starting running test items Worker 349: 08:20:04 | maxrss 2.1% | mem 2.9% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 349: 08:20:04 | maxrss 2.1% | mem 2.9% | DONE (1/2) test item "same name" 0.2 secs (93.6% compile), 21.12 K allocs (1.119 MB) Worker 349: 08:20:05 | maxrss 2.1% | mem 2.9% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 349: 08:20:05 | maxrss 2.1% | mem 2.9% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.864 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=349). Worker 349: [349] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x735a7ed97f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 354: [ Info: Starting test worker 1 on pid = 354, with 2 threads [ Info: Starting running test items Worker 354: [354] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 354 ┌ Error: Worker(pid=354, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 359: [ Info: Starting test worker on pid = 359, with 2 threads Worker 359: [359] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 359 ┌ Error: Worker(pid=359, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=359, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:26:29 | maxrss 2.1% | mem 2.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) 08:26:29 | maxrss 2.1% | mem 2.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) 08:26:29 | maxrss 2.1% | mem 2.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 08:26:29 | maxrss 2.1% | mem 2.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 15 Error in testset "happy 1" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 08:26:29 | maxrss 2.1% | mem 2.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 15 Error in testset "happy 2" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 08:26:29 | maxrss 2.1% | mem 2.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 08:26:29 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 15 Error in testset "happy 3" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 486: [ Info: Starting test worker 1 on pid = 486, with 2 threads [ Info: Starting running test items Worker 486: 08:26:44 | maxrss 2.1% | mem 2.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 486: 08:26:45 | maxrss 2.1% | mem 2.9% | DONE (1/3) test item "happy 1" 0.2 secs (92.3% compile), 21.73 K allocs (1.135 MB) Worker 486: 08:26:45 | maxrss 2.1% | mem 2.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 486: 08:26:45 | maxrss 2.1% | mem 2.9% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) Worker 486: 08:26:45 | maxrss 2.1% | mem 2.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 486: 08:26:45 | maxrss 2.1% | mem 2.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=486). Worker 486: [486] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 491: [ Info: Starting test worker 1 on pid = 491, with 2 threads [ Info: Starting running test items Worker 491: 08:27:00 | maxrss 2.1% | mem 2.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 491: 08:27:01 | maxrss 2.1% | mem 2.9% | DONE (1/3) test item "happy 1" 0.2 secs (93.1% compile), 21.35 K allocs (1.121 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 491 Error in testset "happy 1" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 491: 08:27:03 | maxrss 2.1% | mem 2.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 491: 08:27:03 | maxrss 2.1% | mem 2.9% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 491 Error in testset "happy 2" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 491: 08:27:04 | maxrss 2.1% | mem 2.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 491: 08:27:04 | maxrss 2.1% | mem 2.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 491 Error in testset "happy 3" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=491). Worker 491: [491] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 496: [ Info: Starting test worker 1 on pid = 496, with 2 threads Worker 498: [ Info: Starting test worker 2 on pid = 498, with 2 threads [ Info: Starting running test items Worker 496: 08:27:35 | maxrss 2.1% | mem 3.6% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 498: 08:27:35 | maxrss 2.1% | mem 3.6% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 496: 08:27:36 | maxrss 2.1% | mem 3.6% | DONE (1/3) test item "happy 1" 0.4 secs (86.6% compile), 21.73 K allocs (1.135 MB) Worker 498: 08:27:36 | maxrss 2.1% | mem 3.6% | DONE (2/3) test item "happy 2" 0.4 secs (92.0% compile), 21.73 K allocs (1.135 MB) Worker 498: 08:27:38 | maxrss 2.1% | mem 3.5% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 498: 08:27:38 | maxrss 2.1% | mem 3.5% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=496). Worker 496: [496] signal 15: Terminated [ Info: All tests on worker 2 completed. Closing Worker(pid=498). Worker 498: [498] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 508: [ Info: Starting test worker 2 on pid = 508, with 2 threads Worker 506: [ Info: Starting test worker 1 on pid = 506, with 2 threads [ Info: Starting running test items Worker 508: 08:28:08 | maxrss 2.1% | mem 3.7% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 506: 08:28:09 | maxrss 2.1% | mem 3.7% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 508: 08:28:11 | maxrss 2.1% | mem 3.7% | DONE (2/3) test item "happy 2" 0.4 secs (93.5% compile), 21.35 K allocs (1.121 MB) Worker 506: 08:28:12 | maxrss 2.1% | mem 3.7% | DONE (1/3) test item "happy 1" 0.4 secs (93.2% compile), 21.35 K allocs (1.121 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 508 Error in testset "happy 2" on worker 508: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 506 Error in testset "happy 1" on worker 506: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 508: 08:28:14 | maxrss 2.1% | mem 3.7% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 508: 08:28:14 | maxrss 2.1% | mem 3.7% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=506). Worker 506: [506] signal 15: Terminated No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 508 Error in testset "happy 3" on worker 508: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=508). Worker 508: [508] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 516: [ Info: Starting test worker 1 on pid = 516, with 2 threads [ Info: Starting running test items Worker 516: 08:28:30 | maxrss 2.1% | mem 2.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 516: 08:28:30 | maxrss 2.1% | mem 2.9% | DONE (1/3) test item "happy 1" 0.2 secs (93.7% compile), 21.83 K allocs (1.146 MB) Worker 516: 08:28:31 | maxrss 2.1% | mem 2.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 516: 08:28:31 | maxrss 2.1% | mem 2.9% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.05 K allocs (100.416 KB) Worker 516: 08:28:31 | maxrss 2.1% | mem 2.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 516: 08:28:31 | maxrss 2.1% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.05 K allocs (100.416 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=516). Worker 516: [516] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 15.8s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 521: [ Info: Starting test worker 1 on pid = 521, with 2 threads [ Info: Starting running test items Worker 521: 08:28:46 | maxrss 2.1% | mem 2.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 521: 08:28:48 | maxrss 2.1% | mem 2.9% | DONE (1/3) test item "happy 1" 0.4 secs (95.0% compile), 59.62 K allocs (3.320 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 521: 08:28:49 | maxrss 2.1% | mem 2.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 521: 08:28:49 | maxrss 2.1% | mem 2.9% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.02 K allocs (138.656 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 521: 08:28:49 | maxrss 2.1% | mem 2.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 521: 08:28:49 | maxrss 2.1% | mem 2.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.02 K allocs (138.656 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=521). Worker 521: [521] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7f6b0aa1af14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 526: [ Info: Starting test worker 1 on pid = 526, with 2 threads [ Info: Starting running test items Worker 526: 08:29:04 | maxrss 2.2% | mem 3.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 526: 08:29:05 | maxrss 2.2% | mem 2.9% | DONE (1/2) test item "correct usage" 0.4 secs (97.2% compile, 14.2% GC), 61.82 K allocs (3.227 MB) Worker 526: 08:29:06 | maxrss 2.2% | mem 2.9% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 526: 08:29:06 | maxrss 2.2% | mem 2.9% | DONE (2/2) test item "incorrect usage" <0.1 secs (71.1% compile), 2.88 K allocs (149.320 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=526). Worker 526: [526] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 531: [ Info: Starting test worker 1 on pid = 531, with 2 threads [ Info: Starting running test items Worker 531: 08:29:21 | maxrss 2.2% | mem 2.9% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 531: 08:29:22 | maxrss 2.2% | mem 2.9% | DONE (1/2) test item "correct usage" 0.6 secs (96.8% compile), 213.02 K allocs (11.390 MB) Worker 531: 08:29:23 | maxrss 2.2% | mem 2.9% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 531: 08:29:24 | maxrss 2.2% | mem 2.9% | DONE (2/2) test item "incorrect usage" <0.1 secs (52.6% compile), 4.66 K allocs (221.984 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 531 Error in testset "no pins left at end of test" on worker 531: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1198 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=531). Worker 531: [531] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 9 tests on pid 15 08:29:24 | maxrss 2.2% | mem 2.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 08:29:25 | maxrss 2.2% | mem 2.2% | DONE (1/9) test item "do_thing Pass" 0.2 secs (95.7% compile, 70.4% recompile), 63.91 K allocs (3.571 MB) 08:29:25 | maxrss 2.2% | mem 2.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 08:29:25 | maxrss 2.2% | mem 2.2% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.48 K allocs (121.408 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 [ Info: RUNNING Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.9150201548329495, 0.18813478903038716, 0.9068197943066979] == 1 08:29:25 | maxrss 2.2% | mem 2.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 08:29:25 | maxrss 2.2% | mem 2.2% | DONE (3/9) test item "do_thing Error" 0.8 secs (<0.1% compile), 258.28 K allocs (22.916 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 [ Info: RUNNING Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 08:29:25 | maxrss 2.2% | mem 2.2% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 08:29:26 | maxrss 2.2% | mem 2.2% | DONE (4/9) test item "bad setup, good test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 [51] top-level scope @ none:6 [52] eval @ ./boot.jl:430 [inlined] [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:29:26 | maxrss 2.2% | mem 2.2% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 08:29:26 | maxrss 2.2% | mem 2.2% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 [51] top-level scope @ none:6 [52] eval @ ./boot.jl:430 [inlined] [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:29:26 | maxrss 2.2% | mem 2.2% | START (6/9) test item "errors" at test/error_tests.jl:1 08:29:27 | maxrss 2.2% | mem 2.2% | DONE (6/9) test item "errors" 1.1 secs (<0.1% compile), 25.55 K allocs (1.884 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#883"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#883"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:676 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [32] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [33] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [35] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [40] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [48] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [49] include @ ./sysimg.jl:38 [inlined] [50] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [51] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [52] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [54] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [55] include(fname::String) @ Main ./sysimg.jl:38 [56] top-level scope @ none:6 [57] eval @ ./boot.jl:430 [inlined] [58] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:29:27 | maxrss 2.2% | mem 2.2% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 08:29:28 | maxrss 2.2% | mem 2.2% | DONE (7/9) test item "errors at the top level" 0.3 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 [ Info: RUNNING Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [32] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 [49] eval @ ./boot.jl:430 [inlined] [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 08:29:28 | maxrss 2.2% | mem 2.2% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 08:29:28 | maxrss 2.2% | mem 2.2% | DONE (8/9) test item "nonexistent test setup" 0.3 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [23] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [24] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [26] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [31] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [39] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [40] include @ ./sysimg.jl:38 [inlined] [41] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [42] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [45] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [46] include(fname::String) @ Main ./sysimg.jl:38 [47] top-level scope @ none:6 [48] eval @ ./boot.jl:430 [inlined] [49] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [50] _start() @ Base ./client.jl:531 08:29:28 | maxrss 2.2% | mem 2.2% | START (9/9) test item "failures" at test/failure_tests.jl:1 08:29:28 | maxrss 2.2% | mem 2.2% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.56 K allocs (169.592 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.36952814671863954 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 3.5s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.2s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.8s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.4s bad setup, bad test | 1 1 0.4s test/error_tests.jl | 1 6 7 errors | 4 4 1.1s UndefVarError | 2 2 0.6s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.3s nonexistent test setup | 1 1 0.3s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1270. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 581: [ Info: Starting test worker 1 on pid = 581, with 2 threads [ Info: Starting running test items Worker 581: 08:32:04 | maxrss 2.3% | mem 3.0% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 581: 08:32:05 | maxrss 2.3% | mem 3.0% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (94.5% compile), 21.12 K allocs (1.119 MB) Worker 581: 08:32:05 | maxrss 2.3% | mem 3.0% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 581: 08:32:06 | maxrss 2.3% | mem 3.0% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.97 K allocs (98.064 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 581 Error in testset "skip false, 1 pass, 1 fail" on worker 581: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl:8 Expression: false Worker 581: 08:32:06 | maxrss 2.3% | mem 3.0% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 581: 08:32:06 | maxrss 2.3% | mem 3.0% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 581: 08:32:06 | maxrss 2.3% | mem 3.0% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.97 K allocs (97.976 KB) Worker 581: 08:32:07 | maxrss 2.3% | mem 3.0% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 581: 08:32:08 | maxrss 2.3% | mem 3.0% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=581). Worker 581: [581] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 20.2s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1280 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl 08:32:19 | maxrss 2.3% | mem 2.8% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Test Summary: | Fail Total Time should fail | 1 1 4.7s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 595: [ Info: Starting test worker 1 on pid = 595, with 2 threads\n Worker 598: [ Info: Starting test worker 3 on pid = 598, with 2 threads\n Worker 597: [ Info: Starting test worker 2 on pid = 597, with 2 threads\n[ Info: Starting running test items\n Worker 597: [597] signal 15: Terminated\nin expression starting at none:1\n_ZNK4llvm5Value12getValueNameEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZNK4llvm5Value7getNameEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZNK4llvm21TargetLibraryInfoImpl10getLibFuncERKNS_8FunctionERNS_7LibFuncE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 595: [595] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7a22668b6f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 598: [598] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x745407b6ff14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 598\n┌ Error: Worker(pid=598, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 595\n┌ Error: Worker(pid=595, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 597\n┌ Error: Worker(pid=597, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 610: [ Info: Starting test worker on pid = 610, with 2 threads\n Worker 614: [ Info: Starting test worker on pid = 614, with 2 threads\n Worker 616: [ Info: Starting test worker on pid = 616, with 2 threads\n Worker 610: [610] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm17JumpThreadingPass32maybethreadThroughTwoBasicBlocksEPNS_10BasicBlockEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 614: [614] signal 15: Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 610\n┌ Error: Worker(pid=610, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=610, terminated=true, termsignal=9).\n Worker 616: [616] signal 15: Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 614\n┌ Error: Worker(pid=614, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 1 completed. Closing Worker(pid=614, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 616\n┌ Error: Worker(pid=616, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=616, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 672: [ Info: Starting test worker 2 on pid = 672, with 2 threads\n Worker 670: [ Info: Starting test worker 1 on pid = 670, with 2 threads\n Worker 673: [ Info: Starting test worker 3 on pid = 673, with 2 threads\n[ Info: Starting running test items\n Worker 673: [673] signal 15: Terminated\n\n Worker 672: [672] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f857317cf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 670: [670] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x79f06786cf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 672\n┌ Error: Worker(pid=672, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\n\nNo Captured LogsNo Captured Logs for test item \"may not run\" at for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:9test/testfiles/_failfast_timeout_tests.jl:1 on worker 673\n┌ Error: Worker(pid=673, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n on worker 670[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\n┌ Error: Worker(pid=670, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 689: [ Info: Starting test worker on pid = 689, with 2 threads\n Worker 685: [ Info: Starting test worker on pid = 685, with 2 threads\n Worker 687: [ Info: Starting test worker on pid = 687, with 2 threads\n Worker 685: [685] signal 15: Terminated\nin expression starting at none:1\n\n Worker 689: [689] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x72c521423f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 687: [687] signal 15: Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 689\n┌ Error: Worker(pid=689, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=689, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 685\n┌ Error: Worker(pid=685, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=685, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 687\n┌ Error: Worker(pid=687, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=687, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 710: [ Info: Starting test worker 1 on pid = 710, with 2 threads\n Worker 712: [ Info: Starting test worker 2 on pid = 712, with 2 threads\n Worker 713: [ Info: Starting test worker 3 on pid = 713, with 2 threads\n[ Info: Starting running test items\n Worker 713: [713] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x74bb926f2f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 710: [710] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x774171381f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 712: [712] signal 15: Terminated\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 712\n┌ Error: Worker(pid=712, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 710\n┌ Error: Worker(pid=710, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 713\n┌ Error: Worker(pid=713, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 727: [ Info: Starting test worker on pid = 727, with 2 threads\n Worker 725: [ Info: Starting test worker on pid = 725, with 2 threads\n Worker 728: [ Info: Starting test worker on pid = 728, with 2 threads\n Worker 727: [727] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x78d4462d8f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 725: [725] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm5Value12setValueNameEPNS_14StringMapEntryIPS0_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm5Value11deleteValueEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm10BasicBlockD1Ev at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm10BasicBlock15eraseFromParentEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm8Function17dropAllReferencesEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 727\n┌ Error: Worker(pid=727, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=727, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 725\n┌ Error: Worker(pid=725, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=725, terminated=true, termsignal=9).\n Worker 728: [728] signal 15: Terminated\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 728\n┌ Error: Worker(pid=728, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=728, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:679 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1793 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 15 08:40:12 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 08:40:12 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 15 Error in testset "test set" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 15 08:40:15 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 08:40:15 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 15 Error in testset "Failure at toplevel" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 08:40:15 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 08:40:15 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 15 Error in testset "Bar" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. 08:40:28 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:8 08:40:28 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" 0.2 secs (95.8% compile), 60.19 K allocs (3.544 MB) 08:40:28 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:21 08:40:28 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" <0.1 secs, 1.36 K allocs (207.584 KB) 08:40:29 | maxrss 2.3% | mem 2.9% | START test item "uses printstyled" at _test_log_capture.jl:34 08:40:29 | maxrss 2.3% | mem 2.9% | DONE test item "uses printstyled" 0.3 secs (98.4% compile), 272.60 K allocs (15.342 MB) 08:40:29 | maxrss 2.3% | mem 2.9% | START test item "uses @error" at _test_log_capture.jl:47 08:40:32 | maxrss 2.3% | mem 3.0% | DONE test item "uses @error" 2.5 secs (99.6% compile, 0.7% GC), 1.25 M allocs (67.510 MB) 08:40:32 | maxrss 2.3% | mem 3.0% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 08:40:33 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @info" 0.3 secs (95.7% compile), 41.29 K allocs (2.279 MB) 08:40:33 | maxrss 2.3% | mem 3.0% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 08:40:33 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @error" <0.1 secs (80.7% compile), 16.68 K allocs (928.184 KB) 08:40:33 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 08:40:33 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stdout" 0.2 secs (94.4% compile), 49.48 K allocs (2.760 MB) 08:40:34 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 08:40:34 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stderr" 0.2 secs (94.3% compile), 30.62 K allocs (1.703 MB) 08:40:34 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 08:40:35 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger (redirect to a file)" 0.5 secs (97.5% compile), 187.24 K allocs (10.364 MB) 08:40:35 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger" at _test_log_capture.jl:149 08:40:35 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger" <0.1 secs (90.2% compile), 20.87 K allocs (1.210 MB) 08:40:35 | maxrss 2.3% | mem 3.0% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 08:40:36 | maxrss 2.3% | mem 3.0% | DONE test item "uses display" 0.8 secs (99.3% compile), 326.54 K allocs (16.319 MB) 08:40:37 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:184 08:40:37 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.45 K allocs (84.880 KB) 08:40:37 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:199 08:40:37 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.45 K allocs (84.592 KB) 08:40:38 | maxrss 2.3% | mem 3.0% | START test item "setup uses printstyled" at _test_log_capture.jl:214 08:40:38 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses printstyled" <0.1 secs, 1.45 K allocs (84.592 KB) 08:40:38 | maxrss 2.3% | mem 3.0% | START test item "setup uses @error" at _test_log_capture.jl:229 08:40:38 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses @error" <0.1 secs, 1.45 K allocs (84.592 KB) 08:40:38 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 08:40:38 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.99 K allocs (105.536 KB) 08:40:39 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 08:40:39 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.99 K allocs (105.536 KB) 08:40:39 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 08:40:39 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.00 K allocs (106.712 KB) 08:40:39 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger" at _test_log_capture.jl:315 08:40:39 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger" <0.1 secs, 1.45 K allocs (86.224 KB) 08:40:39 | maxrss 2.3% | mem 3.0% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 08:40:40 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses display" <0.1 secs, 1.45 K allocs (84.592 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 16.1s 08:40:49 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:8 08:40:49 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" 0.1 secs (93.1% compile), 36.97 K allocs (2.051 MB) 08:40:49 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:21 08:40:49 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" <0.1 secs, 1.38 K allocs (77.952 KB) 08:40:49 | maxrss 2.3% | mem 2.9% | START test item "uses printstyled" at _test_log_capture.jl:34 08:40:49 | maxrss 2.3% | mem 2.9% | DONE test item "uses printstyled" <0.1 secs (67.4% compile), 1.45 K allocs (81.672 KB) 08:40:49 | maxrss 2.3% | mem 2.9% | START test item "uses @error" at _test_log_capture.jl:47 08:40:52 | maxrss 2.3% | mem 2.9% | DONE test item "uses @error" 2.6 secs (99.6% compile, 6.7% GC), 1.24 M allocs (66.896 MB) 08:40:52 | maxrss 2.3% | mem 2.9% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 08:40:52 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @info" 0.3 secs (95.4% compile), 41.35 K allocs (2.282 MB) 08:40:52 | maxrss 2.3% | mem 3.0% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 08:40:52 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @error" <0.1 secs (79.8% compile), 16.72 K allocs (930.488 KB) 08:40:52 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 08:40:52 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stdout" 0.2 secs (92.4% compile), 49.66 K allocs (2.768 MB) 08:40:52 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 08:40:53 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stderr" 0.1 secs (94.1% compile), 30.66 K allocs (1.705 MB) 08:40:53 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 08:40:53 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger (redirect to a file)" 0.5 secs (96.9% compile), 187.28 K allocs (10.367 MB) 08:40:53 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger" at _test_log_capture.jl:149 08:40:53 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger" <0.1 secs (88.1% compile), 22.59 K allocs (1.290 MB) 08:40:53 | maxrss 2.3% | mem 3.0% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 08:40:54 | maxrss 2.3% | mem 3.0% | DONE test item "uses display" 1.2 secs (99.5% compile, 4.6% GC), 606.26 K allocs (31.951 MB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:184 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:199 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses printstyled" at _test_log_capture.jl:214 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses printstyled" <0.1 secs, 1.49 K allocs (86.736 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses @error" at _test_log_capture.jl:229 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses @error" <0.1 secs, 1.49 K allocs (86.984 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 08:40:55 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.04 K allocs (108.992 KB) 08:40:55 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger" at _test_log_capture.jl:315 08:40:56 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger" <0.1 secs, 1.49 K allocs (86.736 KB) 08:40:56 | maxrss 2.3% | mem 3.0% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 08:40:56 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses display" <0.1 secs, 1.49 K allocs (86.696 KB) Test Summary: | Pass Broken Total  Time log capture logs=:batched |  26  2  28 10.5s 08:41:04 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:8 08:41:05 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" 0.1 secs (93.2% compile), 36.97 K allocs (2.051 MB) 08:41:05 | maxrss 2.3% | mem 2.9% | START test item "uses println" at _test_log_capture.jl:21 08:41:05 | maxrss 2.3% | mem 2.9% | DONE test item "uses println" <0.1 secs, 1.38 K allocs (77.952 KB) 08:41:05 | maxrss 2.3% | mem 2.9% | START test item "uses printstyled" at _test_log_capture.jl:34 08:41:05 | maxrss 2.3% | mem 2.9% | DONE test item "uses printstyled" <0.1 secs (66.3% compile), 1.45 K allocs (81.672 KB) 08:41:05 | maxrss 2.3% | mem 2.9% | START test item "uses @error" at _test_log_capture.jl:47 08:41:08 | maxrss 2.3% | mem 2.9% | DONE test item "uses @error" 2.9 secs (99.0% compile, 6.2% GC), 1.24 M allocs (66.897 MB) 08:41:08 | maxrss 2.3% | mem 2.9% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 08:41:08 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @info" 0.3 secs (95.8% compile), 41.35 K allocs (2.282 MB) 08:41:08 | maxrss 2.3% | mem 3.0% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 08:41:08 | maxrss 2.3% | mem 3.0% | DONE test item "uses @test_logs @error" <0.1 secs (84.2% compile), 16.72 K allocs (930.488 KB) 08:41:08 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 08:41:08 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stdout" 0.2 secs (92.0% compile), 49.66 K allocs (2.768 MB) 08:41:08 | maxrss 2.3% | mem 3.0% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 08:41:08 | maxrss 2.3% | mem 3.0% | DONE test item "uses redirect_stderr" 0.2 secs (95.4% compile), 30.66 K allocs (1.705 MB) 08:41:08 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 08:41:09 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger (redirect to a file)" 0.5 secs (97.5% compile), 187.28 K allocs (10.367 MB) 08:41:09 | maxrss 2.3% | mem 3.0% | START test item "uses with_logger" at _test_log_capture.jl:149 08:41:09 | maxrss 2.3% | mem 3.0% | DONE test item "uses with_logger" <0.1 secs (88.3% compile), 22.59 K allocs (1.290 MB) 08:41:09 | maxrss 2.3% | mem 3.0% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 08:41:10 | maxrss 2.3% | mem 3.0% | DONE test item "uses display" 1.1 secs (99.3% compile, 1.7% GC), 606.26 K allocs (31.952 MB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:184 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses println" at _test_log_capture.jl:199 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses printstyled" at _test_log_capture.jl:214 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses printstyled" <0.1 secs, 1.49 K allocs (86.736 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses @error" at _test_log_capture.jl:229 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses @error" <0.1 secs, 1.49 K allocs (86.984 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.04 K allocs (108.992 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses with_logger" at _test_log_capture.jl:315 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses with_logger" <0.1 secs, 1.49 K allocs (86.736 KB) 08:41:11 | maxrss 2.3% | mem 3.0% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 08:41:11 | maxrss 2.3% | mem 3.0% | DONE test item "setup uses display" <0.1 secs, 1.49 K allocs (86.696 KB) Test Summary: | Pass Broken Total  Time log capture logs=:issues |  26  2  28 10.5s Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 5.87 seconds. Scheduling 6 tests on pid 770 08:42:03 | maxrss 2.4% | mem 3.3% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 08:42:04 | maxrss 2.4% | mem 3.3% | DONE (1/6) test item "testitem1" 0.2 secs (94.5% compile), 30.39 K allocs (1.605 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 770 Error in testset "testitem1" on worker 770: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 08:42:05 | maxrss 2.4% | mem 3.3% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 08:42:05 | maxrss 2.4% | mem 3.3% | DONE (2/6) test item "testitem2" 0.3 secs (94.1% compile), 48.68 K allocs (2.748 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 770 Error in testset "inner testset" on worker 770: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 770: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" 08:42:05 | maxrss 2.4% | mem 3.3% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 08:42:05 | maxrss 2.4% | mem 3.3% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 2.03 K allocs (99.896 KB) 08:42:05 | maxrss 2.4% | mem 3.3% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 08:42:08 | maxrss 2.4% | mem 3.4% | DONE (4/6) test item "testitem4" 3.1 secs (90.1% compile, 1.2% GC), 877.08 K allocs (50.271 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 770 Error in testset "nested testset" on worker 770: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined in `Main.var"##testitem4#242"` Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1704 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:430 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [13] open @ ./io.jl:407 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [19] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [20] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:522 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:632 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [24] #runtests#46 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:236 [inlined] [25] top-level scope @ none:1 [26] eval @ ./boot.jl:430 [inlined] [27] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [28] _start() @ Base ./client.jl:531 08:42:08 | maxrss 2.4% | mem 3.4% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 08:42:08 | maxrss 2.4% | mem 3.4% | DONE (5/6) test item "testitem5" <0.1 secs (89.6% compile), 2.38 K allocs (114.504 KB) 08:42:08 | maxrss 2.4% | mem 3.4% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 08:42:08 | maxrss 2.4% | mem 3.4% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.88 K allocs (133.904 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 770 Error in testset "testitem6" on worker 770: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_nI7id9/report-ReTestItems-20250408-084203.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 9.7s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 0.2s testitem2 | 1 1 1 3 0.3s inner testset | 1 1 2 0.2s testitem3 | 2 2 0.0s testitem4 | 1 1 3.1s nested testset | 1 1 3.1s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 5.62 seconds. Scheduling 6 tests on pid 774 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 774 running 1 of 1 signal (10): User defined signal 1 _ZN12_GLOBAL__N_111DAGCombiner13AddToWorklistEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm12SelectionDAG7CombineENS_12CombineLevelEPNS_9AAResultsENS_10CodeGenOpt5LevelE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel17CodeGenAndEmitDAGEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel20SelectAllBasicBlocksERKNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel20runOnMachineFunctionERNS_15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_115X86DAGToDAGISel20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) operator() at /source/src/jitlayers.cpp:1388 _ZN4llvm3orc14IRCompileLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc19MaterializationTask3runEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_vEEEENSG_ISD_vEENS_6detail12DenseMapPairISD_SI_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_vEENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_vEENSN_IS6_SV_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EENS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISI_vEEEENSJ_IS5_vEENS_6detail12DenseMapPairIS5_SL_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) addModule at /source/src/jitlayers.cpp:1875 jl_add_to_ee at /source/src/jitlayers.cpp:2306 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 _jl_compile_codeinst at /source/src/jitlayers.cpp:277 jl_generate_fptr_impl at /source/src/jitlayers.cpp:536 jl_compile_method_internal at /source/src/gf.c:2536 [inlined] jl_compile_method_internal at /source/src/gf.c:2423 _jl_invoke at /source/src/gf.c:2940 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_apply at /source/src/builtins.c:831 #106#107 at ./error.jl:300 #106 at ./error.jl:295 [inlined] #robust_start_worker#66 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:511 [inlined] robust_start_worker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:509 [inlined] #56 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:435 [inlined] with_logstate at ./logging/logging.jl:522 with_logger at ./logging/logging.jl:632 [inlined] #55 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:434 unknown function (ip: 0x7a440858af1f) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 15 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#731 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] wait at ./process.jl:694 wait at ./process.jl:687 [inlined] success at ./process.jl:556 [inlined] #run#897 at ./process.jl:513 run at ./process.jl:510 [inlined] #460 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:84 withenv at ./env.jl:265 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_invoke at /source/src/gf.c:2955 #459 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:82 [inlined] #mktempdir#28 at ./file.jl:819 unknown function (ip: 0x70423a008a5d) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 mktempdir at ./file.jl:815 mktempdir at ./file.jl:815 unknown function (ip: 0x70423a007ac2) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 _include at ./loading.jl:2794 include at ./sysimg.jl:38 [inlined] #2 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:33 withenv at ./env.jl:265 unknown function (ip: 0x704250b08ee3) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 _include at ./loading.jl:2794 include at ./sysimg.jl:38 unknown function (ip: 0x704250b00082) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] exec_options at ./client.jl:296 _start at ./client.jl:531 jfptr__start_73523.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] true_main at /source/src/jlapi.c:900 jl_repl_entrypoint at /source/src/jlapi.c:1059 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x704251e4f249) __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x0000704244800010 Total snapshots: 224. Utilization: 0% ╎224 @Base/client.jl:531; _start() ╎ 224 @Base/client.jl:296; exec_options(opts::Base.JLOptions) ╎ 224 @Base/boot.jl:430; eval ╎ 224 @Base/sysimg.jl:38; include(fname::String) ╎ 224 @Base/loading.jl:2794; _include(mapexpr::Function, mod::Module, _pa… ╎ 224 @Base/loading.jl:2734; include_string(mapexpr::typeof(identity), m… ╎ ╎ 224 @Base/boot.jl:430; eval ╎ ╎ 224 @Base/env.jl:265; withenv(f::var"#2#4", keyvals::Pair{String, In… ╎ ╎ 224 …ms/test/runtests.jl:33; (::var"#2#4")() ╎ ╎ 224 @Base/sysimg.jl:38; include ╎ ╎ 224 @Base/loading.jl:2794; _include(mapexpr::Function, mod::Modul… ╎ ╎ ╎ 224 @Base/loading.jl:2734; include_string(mapexpr::typeof(identi… ╎ ╎ ╎ 224 @Base/boot.jl:430; eval ╎ ╎ ╎ 224 @Base/file.jl:815; mktempdir(fn::Function) ╎ ╎ ╎ 224 @Base/file.jl:815; mktempdir(fn::Function, parent::String) ╎ ╎ ╎ 224 @Base/file.jl:819; mktempdir(fn::var"#459#476"{String, I… ╎ ╎ ╎ ╎ 224 …est/junit_xml.jl:82; #459 ╎ ╎ ╎ ╎ 224 @Base/env.jl:265; withenv(::var"#460#477"{String, Stri… ╎ ╎ ╎ ╎ 224 …st/junit_xml.jl:84; (::var"#460#477"{String, String}… ╎ ╎ ╎ ╎ 224 @Base/process.jl:510; run ╎ ╎ ╎ ╎ 224 …ase/process.jl:513; run(::Cmd; wait::Bool) ╎ ╎ ╎ ╎ ╎ 224 …ase/process.jl:556; success ╎ ╎ ╎ ╎ ╎ 224 …se/process.jl:687; wait ╎ ╎ ╎ ╎ ╎ 224 …se/process.jl:694; wait(x::Base.Process, syncd:… ╎ ╎ ╎ ╎ ╎ 224 …/condition.jl:125; wait ╎ ╎ ╎ ╎ ╎ 224 …condition.jl:130; wait(c::Base.GenericConditi… ╎ ╎ ╎ ╎ ╎ ╎ 224 …ase/task.jl:1021; wait() 223╎ ╎ ╎ ╎ ╎ ╎ 224 …ase/task.jl:1012; poptask(W::Base.Intrusive… ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x00007a43e43d0010 Total snapshots: 163. Utilization: 100% ╎136 …ems/src/ReTestItems.jl:434; (::ReTestItems.var"#55#60"{Base.CoreLoggin… ╎ 136 …ase/logging/logging.jl:632; with_logger ╎ 136 …se/logging/logging.jl:522; with_logstate(f::ReTestItems.var"#56#61"{… ╎ 136 …ms/src/ReTestItems.jl:435; #56 ╎ 136 …ms/src/ReTestItems.jl:509; robust_start_worker ╎ 136 …s/src/ReTestItems.jl:511; #robust_start_worker#66 ╎ ╎ 136 @Base/error.jl:295; #106 135╎ ╎ 136 @Base/error.jl:300; (::Base.var"#106#108"{Base.var"#106#107#109"… Worker 778: [ Info: Starting test worker 1 on pid = 778, with 2 threads [ Info: Starting running test items ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 task_done_hook at ./task.jl:694 jfptr_task_done_hook_66630.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] jl_finish_task at /source/src/task.c:319 start_task at /source/src/task.c:1213 unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x00007799a4cae270 Total snapshots: 343. Utilization: 0% ╎343 @Base/task.jl:694; task_done_hook(t::Task) ╎ 343 @Base/task.jl:1021; wait() 342╎ 343 @Base/task.jl:1012; poptask(W::Base.IntrusiveLinkedListSynchronized{T… Worker 778: 08:43:21 | maxrss 1.5% | mem 4.4% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 [774] signal 15: Terminated in expression starting at none:1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) [15] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:76 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 poptask at ./task.jl:1012 #wait#731 at ./condition.jl:130 wait at ./task.jl:1021 wait at ./condition.jl:125 [inlined] PkgEval terminated after 2741.23s: test duration exceeded the time limit