Package evaluation of ReTestItems on Julia 1.11.5 (32ac370b68*) started at 2025-06-29T05:45:06.732 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 9.04s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [817f1d60] + ReTestItems v1.31.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [817f1d60] + ReTestItems v1.31.0 [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 1.16s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 20.77s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_p4kSwe/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_p4kSwe/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.1 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.0 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 ⌅ [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Worker 27: [27] signal 15: Terminated Worker 31: [31] signal 15: Terminated Worker 39: [39] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:125 05:47:11 | maxrss 1.3% | mem 1.4% | SKIP (0/1) test item "skip" at internals.jl:288 05:47:16 | maxrss 1.4% | mem 1.4% | START test item "TI1" at macros.jl:32 05:47:16 | maxrss 1.4% | mem 1.4% | DONE test item "TI1" 0.1 secs (95.7% compile), 70.87 K allocs (3.991 MB) 05:47:16 | maxrss 1.4% | mem 1.4% | START test item "TI2" at macros.jl:43 05:47:16 | maxrss 1.4% | mem 1.4% | DONE test item "TI2" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 05:47:17 | maxrss 1.4% | mem 1.4% | START test item "TI" at macros.jl:53 05:47:17 | maxrss 1.4% | mem 1.4% | DONE test item "TI" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 05:47:17 | maxrss 1.4% | mem 1.4% | START test item "macro-import" at macros.jl:64 05:47:19 | maxrss 1.4% | mem 1.4% | DONE test item "macro-import" 2.4 secs (99.5% compile, 0.8% GC), 822.49 K allocs (44.834 MB) 05:47:19 | maxrss 1.4% | mem 1.4% | START test item "Foo" at macros.jl:95 05:47:20 | maxrss 1.4% | mem 1.4% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.79 K allocs (135.256 KB) 05:47:20 | maxrss 1.4% | mem 1.4% | START test item "Foo3" at macros.jl:110 05:47:20 | maxrss 1.4% | mem 1.4% | DONE test item "Foo3" <0.1 secs (56.7% compile), 2.94 K allocs (144.936 KB) 05:47:20 | maxrss 1.4% | mem 1.4% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:109 [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [7] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [8] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [9] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1007 [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:123 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:118 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:23 [15] include @ ./sysimg.jl:38 [inlined] [16] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:20 [17] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [18] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [20] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [21] include(fname::String) @ Main ./sysimg.jl:38 [22] top-level scope @ none:6 05:47:24 | maxrss 1.6% | mem 1.6% | DONE test item "Foo4" 05:47:24 | maxrss 1.6% | mem 1.6% | START test item "testitem active" at macros.jl:138 05:47:24 | maxrss 1.6% | mem 1.6% | DONE test item "testitem active" <0.1 secs (86.2% compile), 3.29 K allocs (168.672 KB) 05:47:24 | maxrss 1.6% | mem 1.6% | START test item "run" at macros.jl:146 05:47:24 | maxrss 1.6% | mem 1.6% | DONE test item "run" <0.1 secs (<0.1% compile), 1.52 K allocs (78.272 KB) 05:47:25 | maxrss 1.6% | mem 1.6% | START test item "comparisons" at macros.jl:182 05:47:26 | maxrss 1.6% | mem 1.6% | DONE test item "comparisons" 0.2 secs (85.7% compile), 30.15 K allocs (1.786 MB) 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa bool" at macros.jl:306 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "test contains error" at macros.jl:314 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 1" at macros.jl:335 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 2" at macros.jl:345 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr loads module" at macros.jl:362 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 05:47:33 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 05:47:33 | maxrss 1.6% | mem 1.6% | START test item "default_imports" at macros.jl:424 05:47:33 | maxrss 1.6% | mem 1.6% | DONE test item "default_imports" <0.1 secs (54.0% compile), 1.96 K allocs (95.024 KB) 05:47:33 | maxrss 1.6% | mem 1.6% | START test item "no_default_imports" at macros.jl:432 05:47:33 | maxrss 1.6% | mem 1.6% | DONE test item "no_default_imports" 0.1 secs (96.5% compile), 298.11 K allocs (16.748 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` Updating `~/.julia/packages/ReTestItems/Q6zs8/Project.toml` [1e6cf692] + TestEnv v1.102.1 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/Q6zs8/Manifest.toml` [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 05:48:08 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 05:48:08 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.88 K allocs (101.288 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:48:08 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 05:48:08 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.328 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 05:48:08 | maxrss 1.8% | mem 1.8% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 05:48:08 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.328 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` 05:48:11 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at src/foo_test.jl:1 05:48:12 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" 0.7 secs (3.3% compile), 71.54 K allocs (7.603 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 19 05:48:13 | maxrss 1.9% | mem 1.9% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (7/8) test item "bar" at src/bar_tests.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (7/8) test item "bar" 0.7 secs (95.1% compile, 2.4% GC), 330.53 K allocs (15.762 MB) 05:48:13 | maxrss 1.9% | mem 1.9% | START (8/8) test item "foo" at src/foo_test.jl:1 05:48:13 | maxrss 1.9% | mem 1.9% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (108.496 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.99 seconds. Scheduling 1 tests on pid 19 05:48:16 | maxrss 1.9% | mem 1.9% | START (1/1) test item "bar" at src/bar_tests.jl:1 05:48:16 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.08 seconds. Scheduling 1 tests on pid 19 05:48:19 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 05:48:19 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.15 seconds. Scheduling 1 tests on pid 19 05:48:21 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 05:48:21 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.15 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.1 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 5 tests on pid 19 05:48:26 | maxrss 1.9% | mem 1.9% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 05:48:26 | maxrss 1.9% | mem 1.9% | DONE (1/5) test item "scope test - loops" <0.1 secs (73.6% compile), 4.13 K allocs (212.576 KB) 05:48:26 | maxrss 1.9% | mem 1.9% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 05:48:26 | maxrss 1.9% | mem 1.9% | DONE (2/5) test item "scope test - setups" <0.1 secs (77.6% compile), 4.38 K allocs (226.816 KB) 05:48:26 | maxrss 1.9% | mem 1.9% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 05:48:26 | maxrss 1.9% | mem 1.9% | DONE (3/5) test item "scope test - testsets" <0.1 secs (64.9% compile), 5.09 K allocs (250.608 KB) 05:48:26 | maxrss 1.9% | mem 1.9% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 05:48:26 | maxrss 1.9% | mem 1.9% | DONE (4/5) test item "scope test - imports" <0.1 secs (73.5% compile), 8.49 K allocs (412.176 KB) 05:48:26 | maxrss 1.9% | mem 1.9% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 05:48:26 | maxrss 1.9% | mem 1.9% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.71 K allocs (127.424 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/Manifest.toml:0 Testing NoDeps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_4mewRY/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test v1.11.0 Status `/tmp/jl_4mewRY/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.09 seconds. Scheduling 2 tests on pid 61 05:48:52 | maxrss 1.9% | mem 2.6% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 05:48:52 | maxrss 1.9% | mem 2.6% | DONE (1/2) test item "toplevel" 0.2 secs (95.4% compile), 29.55 K allocs (1.573 MB) 05:48:52 | maxrss 1.9% | mem 2.6% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 05:48:53 | maxrss 1.9% | mem 2.6% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.3% compile), 40.21 K allocs (2.291 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 61 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.4s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.1s Testing NoDeps tests passed Testing TestsInSrc ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_lQWoNo/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_lQWoNo/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.25 seconds. Scheduling 8 tests on pid 65 05:49:16 | maxrss 1.9% | mem 2.6% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 05:49:16 | maxrss 1.9% | mem 2.6% | DONE (1/8) test item "a1" 0.2 secs (94.1% compile), 30.13 K allocs (1.625 MB) 05:49:16 | maxrss 1.9% | mem 2.6% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 05:49:16 | maxrss 1.9% | mem 2.6% | DONE (2/8) test item "a2" 0.2 secs (92.6% compile), 39.12 K allocs (2.238 MB) 05:49:16 | maxrss 1.9% | mem 2.6% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 05:49:16 | maxrss 1.9% | mem 2.7% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 05:49:16 | maxrss 1.9% | mem 2.7% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 05:49:16 | maxrss 1.9% | mem 2.7% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 05:49:16 | maxrss 1.9% | mem 2.7% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 05:49:16 | maxrss 1.9% | mem 2.7% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 05:49:16 | maxrss 1.9% | mem 2.7% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 05:49:16 | maxrss 1.9% | mem 2.7% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.55 K allocs (79.984 KB) 05:49:16 | maxrss 1.9% | mem 2.7% | START (7/8) test item "bar" at src/bar_tests.jl:1 05:49:17 | maxrss 1.9% | mem 2.7% | DONE (7/8) test item "bar" 0.7 secs (97.5% compile), 332.86 K allocs (15.888 MB) 05:49:17 | maxrss 1.9% | mem 2.7% | START (8/8) test item "foo" at src/foo_test.jl:1 05:49:17 | maxrss 1.9% | mem 2.7% | DONE (8/8) test item "foo" <0.1 secs (73.5% compile), 3.70 K allocs (179.464 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.3s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.1s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.7s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed Testing TestProjectFile ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_jfgSAa/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_jfgSAa/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling TestProjectFile... 804.2 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.14 seconds. Scheduling 1 tests on pid 69 05:49:41 | maxrss 1.9% | mem 2.6% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 05:49:44 | maxrss 1.9% | mem 2.7% | DONE (1/1) test item "TestProjectFile" 2.4 secs (38.0% compile, 10.8% recompile), 342.25 K allocs (20.944 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 69 Precompiling InlineStrings... 1242.0 ms ✓ InlineStrings 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 5.5s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.4s test-only dep on InlineStrings | 1 1 2.1s Testing TestProjectFile tests passed Testing TestEndExpr Status `/tmp/jl_hz7Y9Z/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_hz7Y9Z/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling ReTestItems... 3310.4 ms ✓ TestEnv 5033.4 ms ✓ ReTestItems 2 dependencies successfully precompiled in 9 seconds. 26 already precompiled. Precompiling TestEndExpr... 623.7 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.29 seconds. Scheduling 2 tests on pid 81 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 97: [ Info: Starting test worker 1 on pid = 97, with 2 threads [ Info: Starting running test items Worker 97: 05:50:42 | maxrss 1.4% | mem 3.4% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 97: 05:50:42 | maxrss 1.4% | mem 3.4% | DONE (1/2) test item "correct usage" 0.3 secs (96.5% compile), 61.40 K allocs (3.212 MB) Worker 97: 05:50:43 | maxrss 1.4% | mem 3.4% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 97: 05:50:43 | maxrss 1.4% | mem 3.4% | DONE (2/2) test item "incorrect usage" <0.1 secs (69.1% compile), 2.82 K allocs (145.192 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=97). Worker 97: [97] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 29.8s Testing TestEndExpr tests passed Testing DontPass ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_PE2Mzn/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [37e2e46d] LinearAlgebra v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_PE2Mzn/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Precompiling DontPass... 702.1 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.23 seconds. Scheduling 9 tests on pid 102 05:51:09 | maxrss 1.9% | mem 2.7% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 05:51:10 | maxrss 1.9% | mem 2.7% | DONE (1/9) test item "do_thing Pass" 0.7 secs (98.4% compile), 302.69 K allocs (14.295 MB) 05:51:10 | maxrss 1.9% | mem 2.7% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 05:51:11 | maxrss 1.9% | mem 2.7% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.1% compile), 115.28 K allocs (6.607 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 102 Error in testset "do_thing Fail" on worker 102: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.5648473200828097, 0.41127249955132594, 0.3072707095539532] == 1 05:51:12 | maxrss 1.9% | mem 2.7% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 05:51:21 | maxrss 1.9% | mem 2.9% | DONE (3/9) test item "do_thing Error" 9.3 secs (90.9% compile, 0.9% GC), 5.72 M allocs (337.148 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 102 Error in testset "do_thing Error" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 05:51:21 | maxrss 1.9% | mem 2.9% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 05:51:22 | maxrss 1.9% | mem 2.9% | DONE (4/9) test item "bad setup, good test" 1.0 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 102 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 102 Error in testset "bad setup, good test" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 05:51:22 | maxrss 1.9% | mem 2.9% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 05:51:23 | maxrss 1.9% | mem 2.9% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 102 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 102 Error in testset "bad setup, bad test" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 05:51:23 | maxrss 1.9% | mem 2.9% | START (6/9) test item "errors" at test/error_tests.jl:1 05:51:24 | maxrss 1.9% | mem 2.9% | DONE (6/9) test item "errors" 1.5 secs (46.6% compile, 3.5% GC), 159.57 K allocs (9.384 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 102 Error in testset "UndefVarError" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#248"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#248"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [26] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [32] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [33] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [34] include(fname::String) @ Main ./sysimg.jl:38 [35] top-level scope @ none:6 05:51:24 | maxrss 1.9% | mem 2.9% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 05:51:25 | maxrss 1.9% | mem 2.9% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 102 Error in testset "errors at the top level" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [18] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [24] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(fname::String) @ Main ./sysimg.jl:38 [27] top-level scope @ none:6 05:51:25 | maxrss 1.9% | mem 2.9% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 05:51:25 | maxrss 1.9% | mem 2.9% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 102 Error in testset "nonexistent test setup" on worker 102: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [17] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [23] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(fname::String) @ Main ./sysimg.jl:38 [26] top-level scope @ none:6 05:51:25 | maxrss 1.9% | mem 2.9% | START (9/9) test item "failures" at test/failure_tests.jl:1 05:51:25 | maxrss 1.9% | mem 2.9% | DONE (9/9) test item "failures" <0.1 secs (82.2% compile), 12.21 K allocs (600.416 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 102 Error in testset "failures" on worker 102: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 102: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.04276167416349266 < 0 Error in testset "failures" on worker 102: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 19.7s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.4s do_thing Error | 1 1 9.3s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 1.0s bad setup, bad test | 1 1 0.3s test/error_tests.jl | 1 6 7 errors | 4 4 1.8s UndefVarError | 2 2 0.8s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.5s errors at the top level | 1 1 2 0.4s nonexistent test setup | 1 1 0.2s test/failure_tests.jl | 3 3 failures | 3 3 0.1s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 05:51:27 | maxrss 1.9% | mem 1.9% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.62 K allocs (84.560 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.73 K allocs (128.000 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 19 05:51:27 | maxrss 1.9% | mem 1.9% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (7/8) test item "bar" at src/bar_tests.jl:1 05:51:27 | maxrss 1.9% | mem 1.9% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 05:51:27 | maxrss 1.9% | mem 1.9% | START (8/8) test item "foo" at src/foo_test.jl:1 05:51:28 | maxrss 1.9% | mem 1.9% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:51:28 | maxrss 1.9% | mem 1.9% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 05:51:28 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "TestProjectFile" 0.7 secs (72.5% compile, 35.7% recompile, 2.0% GC), 243.94 K allocs (14.054 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 9 tests on pid 19 05:51:32 | maxrss 2.0% | mem 2.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 05:51:32 | maxrss 2.0% | mem 2.0% | DONE (1/9) test item "do_thing Pass" <0.1 secs (73.9% compile), 13.23 K allocs (715.224 KB) 05:51:32 | maxrss 2.0% | mem 2.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 05:51:32 | maxrss 2.0% | mem 2.0% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.2% compile), 116.28 K allocs (6.661 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 19 Error in testset "do_thing Fail" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.21620732093625972, 0.8610257724270033, 0.2321752186437812] == 1 05:51:32 | maxrss 2.0% | mem 2.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 05:51:34 | maxrss 2.0% | mem 2.0% | DONE (3/9) test item "do_thing Error" 1.5 secs (51.1% compile, 2.1% GC), 989.33 K allocs (65.052 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 19 Error in testset "do_thing Error" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 05:51:34 | maxrss 2.0% | mem 2.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 05:51:35 | maxrss 2.0% | mem 2.0% | DONE (4/9) test item "bad setup, good test" 0.7 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 19 Error in testset "bad setup, good test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 05:51:35 | maxrss 2.0% | mem 2.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 05:51:35 | maxrss 2.0% | mem 2.0% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 19 Error in testset "bad setup, bad test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 05:51:35 | maxrss 2.0% | mem 2.0% | START (6/9) test item "errors" at test/error_tests.jl:1 05:51:36 | maxrss 2.0% | mem 2.0% | DONE (6/9) test item "errors" 1.2 secs (17.9% compile), 46.95 K allocs (3.126 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 19 Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#463"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#463"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [31] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [32] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [33] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [34] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [36] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [50] include @ ./sysimg.jl:38 [inlined] [51] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [52] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [55] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [56] include(fname::String) @ Main ./sysimg.jl:38 05:51:36 | maxrss 2.0% | mem 2.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 05:51:37 | maxrss 2.0% | mem 2.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 19 Error in testset "errors at the top level" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [24] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [25] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [26] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [28] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [33] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [42] include @ ./sysimg.jl:38 [inlined] [43] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [44] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [47] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [48] include(fname::String) @ Main ./sysimg.jl:38 [49] top-level scope @ none:6 05:51:37 | maxrss 2.0% | mem 2.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 05:51:37 | maxrss 2.0% | mem 2.0% | DONE (8/9) test item "nonexistent test setup" 0.3 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 19 Error in testset "nonexistent test setup" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 05:51:37 | maxrss 2.0% | mem 2.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 05:51:37 | maxrss 2.0% | mem 2.0% | DONE (9/9) test item "failures" <0.1 secs (80.9% compile), 12.31 K allocs (607.792 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 19 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.24977145075054769 < 0 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:57:29 | maxrss 2.0% | mem 2.0% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 05:57:31 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "MonoRepo tests" 2.6 secs (<0.1% compile, 0.4% GC), 82.31 K allocs (8.780 MB) [ Tests Completed: 1/1 test items were run. Testing C ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_k5W5tV/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test v1.11.0 Status `/tmp/jl_k5W5tV/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.01 seconds. Scheduling 1 tests on pid 191 05:57:54 | maxrss 2.0% | mem 2.8% | START (1/1) test item "C_tests" at test/c_tests.jl:1 05:57:54 | maxrss 2.0% | mem 2.8% | DONE (1/1) test item "C_tests" 0.3 secs (94.5% compile), 42.85 K allocs (2.345 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 3.5s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.3s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:57:56 | maxrss 2.0% | mem 2.0% | START (1/1) test item "C_tests" at test/c_tests.jl:1 05:57:56 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 2.28 K allocs (115.064 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:57:56 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 05:57:56 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:57:58 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 05:57:58 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:57:58 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 05:57:58 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 05:57:58 | maxrss 2.0% | mem 2.0% | START (1/2) test item "bar" at src/bar_tests.jl:1 05:57:58 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 05:57:58 | maxrss 2.0% | mem 2.0% | START (2/2) test item "foo" at src/foo_test.jl:1 05:57:58 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.0 seconds. Scheduling 1 tests on pid 19 05:58:00 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 19 05:58:00 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 05:58:00 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 05:58:00 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 19 05:58:01 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.560 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.528 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.704 KB) 05:58:01 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 05:58:01 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.360 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 05:58:03 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:03 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:03 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:03 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:03 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:03 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. Scheduling 2 tests on pid 19 05:58:05 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:05 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:05 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:05 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.18 seconds. Scheduling 2 tests on pid 19 05:58:06 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:06 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:06 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:06 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 05:58:07 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:07 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 05:58:07 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:07 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.24 seconds. Scheduling 1 tests on pid 19 05:58:09 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:09 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 05:58:09 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:09 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:09 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:09 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:09 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:09 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 05:58:11 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:11 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.07 seconds. Scheduling 1 tests on pid 19 05:58:13 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:13 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 05:58:15 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 05:58:15 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 05:58:15 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 05:58:15 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:15 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:15 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.03 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.13 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. Scheduling 3 tests on pid 19 05:58:22 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:22 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:22 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 05:58:22 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:22 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:58:22 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 05:58:22 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:22 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 05:58:23 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:23 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:23 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:23 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:23 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:23 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.96 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.98 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.01 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.95 seconds. Scheduling 3 tests on pid 19 05:58:34 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 05:58:34 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 05:58:34 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 05:58:34 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.776 KB) 05:58:34 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 05:58:34 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) [ Tests Completed: 3/3 test items were run. 05:58:34 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 05:58:34 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 5.55 K allocs (239.528 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 195: [ Info: Starting test worker 1 on pid = 195, with 2 threads\n[ Info: Starting running test items\n Worker 195: 05:58:51 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 195: 05:58:55 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 3.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n\n Worker 195: 05:58:57 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 195: 05:58:57 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=195).\n Worker 195: [195] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 195: [ Info: Starting test worker 1 on pid = 195, with 2 threads\n[ Info: Starting running test items\n Worker 195: 05:58:51 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 195: 05:58:55 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 3.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n\n Worker 195: 05:58:57 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 195: 05:58:57 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=195).\n Worker 195: [195] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 6 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 210: [ Info: Starting test worker 1 on pid = 210, with 2 threads [ Info: Starting running test items Worker 210: 05:59:48 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 210: 05:59:50 | maxrss 2.1% | mem 2.8% | DONE (1/6) test item "Pass on second run" 0.2 secs (93.2% compile), 6.93 K allocs (342.952 KB) Worker 210: [210] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 210 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 210 ┌ Error: Worker(pid=210, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 215: [ Info: Starting test worker on pid = 215, with 2 threads Worker 215: 06:00:05 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 215: 06:00:06 | maxrss 2.1% | mem 2.8% | DONE (1/6) test item "Pass on second run" 0.2 secs (93.6% compile), 6.93 K allocs (342.952 KB) Worker 215: [215] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 215 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 215 ┌ Error: Worker(pid=215, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 220: [ Info: Starting test worker on pid = 220, with 2 threads Worker 220: 06:00:21 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 220: [220] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 220 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 220 ┌ Error: Worker(pid=220, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 225: [ Info: Starting test worker on pid = 225, with 2 threads Worker 225: 06:00:37 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 225 [225] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZNK4llvm12DenseMapBaseINS_8DenseMapIPNS_10BasicBlockESt10unique_ptrINS_15DomTreeNodeBaseIS2_EESt14default_deleteIS6_EENS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_S9_EEEES3_S9_SB_SE_E15LookupBucketForIS3_EEbRKT_RPKSE_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm8DenseMapIPNS_10BasicBlockESt10unique_ptrINS_15DomTreeNodeBaseIS1_EESt14default_deleteIS5_EENS_12DenseMapInfoIS2_vEENS_6detail12DenseMapPairIS2_S8_EEE4growEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=225, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 230: [ Info: Starting test worker on pid = 230, with 2 threads Worker 230: 06:00:53 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 230 [230] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZN4llvm11isa_impl_clINS_13IntrinsicInstEPKNS_5ValueEE4doitES4_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm31wouldInstructionBeTriviallyDeadEPNS_11InstructionEPKNS_17TargetLibraryInfoE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZL29prepareICWorklistFromFunctionRN4llvm8FunctionERKNS_10DataLayoutEPKNS_17TargetLibraryInfoERNS_19InstructionWorklistE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=230, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 235: [ Info: Starting test worker on pid = 235, with 2 threads Worker 235: 06:01:09 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 235 [235] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 _ZNK4llvm17GetElementPtrInst17hasAllZeroIndicesEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_114CodeGenPrepare12optimizeInstEPN4llvm11InstructionERNS_8ModifyDTE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_114CodeGenPrepare13runOnFunctionERN4llvm8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=235, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 240: [ Info: Starting test worker on pid = 240, with 2 threads Worker 240: 06:01:25 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 240: 06:01:27 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.7% compile), 6.84 K allocs (339.392 KB) Worker 240: [240] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 240 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 240 ┌ Error: Worker(pid=240, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 245: [ Info: Starting test worker on pid = 245, with 2 threads Worker 245: 06:01:42 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 245: [245] signal 15: Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 245 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 245 ┌ Error: Worker(pid=245, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 250: [ Info: Starting test worker on pid = 250, with 2 threads Worker 250: 06:01:58 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 250: [250] signal 15: Terminated in expression starting at none:1 malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) operator new at /workspace/srcdir/gcc-13.2.0/libstdc++-v3/libsupc++/new_op.cc:50 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 250 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 250 ┌ Error: Worker(pid=250, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 255: [ Info: Starting test worker on pid = 255, with 2 threads Worker 255: 06:02:13 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 255: 06:02:15 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.8% compile), 6.84 K allocs (339.392 KB) Worker 255: [255] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 255 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 255 ┌ Error: Worker(pid=255, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 260: [ Info: Starting test worker on pid = 260, with 2 threads Worker 260: 06:02:30 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 260: 06:02:32 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.4% compile), 6.84 K allocs (339.392 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 260 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 260 ┌ Error: Worker(pid=260, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 265: [ Info: Starting test worker on pid = 265, with 2 threads Worker 265: 06:02:46 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 265: 06:02:48 | maxrss 2.1% | mem 2.8% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (93.9% compile), 6.84 K allocs (339.392 KB) Worker 265: [265] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 265 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 265 ┌ Error: Worker(pid=265, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 270: [ Info: Starting test worker on pid = 270, with 2 threads Worker 270: 06:03:02 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 270: 06:03:04 | maxrss 2.1% | mem 2.8% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (93.1% compile), 6.84 K allocs (339.392 KB) Worker 270: [270] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 270 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 270 ┌ Error: Worker(pid=270, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 275: [ Info: Starting test worker on pid = 275, with 2 threads Worker 275: 06:03:18 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 275: 06:03:20 | maxrss 2.1% | mem 2.8% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (93.8% compile), 6.84 K allocs (339.392 KB) Worker 275: [275] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 275 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 275 ┌ Error: Worker(pid=275, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 280: [ Info: Starting test worker on pid = 280, with 2 threads Worker 280: 06:03:34 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 280 [280] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7f8954621f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 task_done_hook at ./task.jl:694 ┌ Error: Worker(pid=280, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 285: [ Info: Starting test worker on pid = 285, with 2 threads Worker 285: 06:03:50 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 285 [285] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x75ae1fa2bf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=285, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 290: [ Info: Starting test worker on pid = 290, with 2 threads Worker 290: 06:04:05 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 290 [290] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7514d1668f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=290, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 295: [ Info: Starting test worker on pid = 295, with 2 threads Worker 295: 06:04:22 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 295 [295] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x75aa8b582f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=295, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 300: [ Info: Starting test worker on pid = 300, with 2 threads Worker 300: 06:04:38 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 300: 06:04:39 | maxrss 2.1% | mem 2.8% | DONE (6/6) test item "Timeout first, pass after" 0.4 secs (96.3% compile, 11.9% GC), 100.83 K allocs (5.355 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=300). Worker 300: [300] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 305: [ Info: Starting test worker 1 on pid = 305, with 2 threads [ Info: Starting running test items Worker 305: 06:04:56 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 305 [305] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7f665e56ff14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=305, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 310: [ Info: Starting test worker on pid = 310, with 2 threads Worker 310: 06:05:11 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 310: 06:05:12 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (93.2% compile), 20.62 K allocs (1.093 MB) Worker 310: [310] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 310 ┌ Error: Worker(pid=310, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=310, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=310, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:766 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:776 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 315: [ Info: Starting test worker 1 on pid = 315, with 2 threads [ Info: Starting running test items Worker 315: 06:05:28 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 315 [315] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7c0479b17f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=315, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 320: [ Info: Starting test worker on pid = 320, with 2 threads Worker 320: 06:05:43 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 320: 06:05:43 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (94.7% compile), 20.62 K allocs (1.093 MB) Worker 320: [320] signal 15: Terminated in expression starting at none:1 _ZN4llvm17PMTopLevelManager17findAnalysisUsageEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm17PMTopLevelManager12schedulePassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16TargetPassConfig7addPassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16TargetPassConfig16addMachinePassesEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 320 ┌ Error: Worker(pid=320, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=320, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=320, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:786 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:798 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 325: [ Info: Starting test worker 1 on pid = 325, with 2 threads [ Info: Starting running test items Worker 325: 06:05:58 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 325 [325] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7230a0a70f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x72309f5cf8e5) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x72309f5cdf6e) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 unknown function (ip: 0x72309f5adb7a) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 ┌ Error: Worker(pid=325, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=325, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 330: [ Info: Starting test worker 1 on pid = 330, with 2 threads [ Info: Starting running test items Worker 330: 06:06:15 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 330 [330] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7ef163aaaf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7ef1626058a5) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x7ef162603f2e) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 unknown function (ip: 0x7ef1625e3b7a) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=330, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=330, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 335: [ Info: Starting test worker 1 on pid = 335, with 2 threads [ Info: Starting running test items Worker 335: 06:06:32 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 335 [335] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7c5c05c0df14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7c5c0473a895) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #96 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 #95 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 #31 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] #runtestitem#94 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 unknown function (ip: 0x7c5c04738f1e) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 unknown function (ip: 0x7c5c04718b7a) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 ┌ Error: Worker(pid=335, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=335, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 0 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 345: [ Info: Starting test worker 1 on pid = 345, with 3,2 threads [ Info: Starting running test items Worker 345: 06:07:08 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 345: 06:07:08 | maxrss 2.1% | mem 2.8% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (94.3% compile), 27.05 K allocs (1.413 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=345). Worker 345: [345] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:874 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:908. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.07 seconds. Scheduling 3 tests on pid 19 06:07:12 | maxrss 2.1% | mem 2.0% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.840 KB) 06:07:12 | maxrss 2.1% | mem 2.0% | START (2/3) test item "other A" at test/integrationtests.jl:900 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) 06:07:12 | maxrss 2.1% | mem 2.0% | START (3/3) test item "other B" at test/integrationtests.jl:900 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 06:07:12 | maxrss 2.1% | mem 2.0% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.840 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 06:07:12 | maxrss 2.1% | mem 2.0% | START (1/2) test item "other A" at test/integrationtests.jl:900 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) 06:07:12 | maxrss 2.1% | mem 2.0% | START (2/2) test item "other B" at test/integrationtests.jl:900 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 06:07:12 | maxrss 2.1% | mem 2.0% | START (1/1) test item "other B" at test/integrationtests.jl:900 06:07:12 | maxrss 2.1% | mem 2.0% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.080 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.64 seconds. Scheduling 0 tests on pid 19 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 06:07:14 | maxrss 2.1% | mem 2.1% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 06:07:14 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.736 KB) 06:07:14 | maxrss 2.1% | mem 2.1% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 06:07:14 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.736 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 353: [ Info: Starting test worker 1 on pid = 353, with 2 threads [ Info: Starting running test items Worker 353: 06:07:27 | maxrss 2.1% | mem 2.7% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 353: 06:07:28 | maxrss 2.1% | mem 2.7% | DONE (1/2) test item "same name" 0.2 secs (94.8% compile), 20.62 K allocs (1.093 MB) Worker 353: 06:07:28 | maxrss 2.1% | mem 2.7% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 353: 06:07:28 | maxrss 2.1% | mem 2.7% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.864 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=353). Worker 353: [353] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 358: [ Info: Starting test worker 1 on pid = 358, with 2 threads [ Info: Starting running test items Worker 358: [358] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7e1b7e9b9d54) malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 358 ┌ Error: Worker(pid=358, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 363: [ Info: Starting test worker on pid = 363, with 2 threads Worker 363: [363] signal 15: Terminated in expression starting at none:1 malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 363 ┌ Error: Worker(pid=363, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=363, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 06:13:46 | maxrss 2.1% | mem 2.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) 06:13:46 | maxrss 2.1% | mem 2.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) 06:13:46 | maxrss 2.1% | mem 2.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.52 K allocs (117.872 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 06:13:46 | maxrss 2.1% | mem 2.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 19 Error in testset "happy 1" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 06:13:46 | maxrss 2.1% | mem 2.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 19 Error in testset "happy 2" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 06:13:46 | maxrss 2.1% | mem 2.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 06:13:46 | maxrss 2.1% | mem 2.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.632 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 19 Error in testset "happy 3" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 485: [ Info: Starting test worker 1 on pid = 485, with 2 threads [ Info: Starting running test items Worker 485: 06:14:01 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 485: 06:14:02 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (92.0% compile), 21.24 K allocs (1.109 MB) Worker 485: 06:14:02 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 485: 06:14:02 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) Worker 485: 06:14:03 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 485: 06:14:03 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=485). Worker 485: [485] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 490: [ Info: Starting test worker 1 on pid = 490, with 2 threads [ Info: Starting running test items Worker 490: 06:14:18 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 490: 06:14:20 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.3% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 490 Error in testset "happy 1" on worker 490: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 490: 06:14:21 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 490: 06:14:21 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 490 Error in testset "happy 2" on worker 490: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 490: 06:14:21 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 490: 06:14:21 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 490 Error in testset "happy 3" on worker 490: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=490). Worker 490: [490] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 495: [ Info: Starting test worker 1 on pid = 495, with 2 threads Worker 497: [ Info: Starting test worker 2 on pid = 497, with 2 threads [ Info: Starting running test items Worker 495: 06:14:52 | maxrss 2.1% | mem 3.5% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 497: 06:14:52 | maxrss 2.1% | mem 3.5% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 495: 06:14:52 | maxrss 2.1% | mem 3.5% | DONE (1/3) test item "happy 1" 0.4 secs (93.8% compile), 21.24 K allocs (1.109 MB) Worker 497: 06:14:53 | maxrss 2.1% | mem 3.5% | DONE (2/3) test item "happy 2" 0.4 secs (92.2% compile), 21.24 K allocs (1.109 MB) Worker 497: 06:14:53 | maxrss 2.1% | mem 3.5% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 497: 06:14:53 | maxrss 2.1% | mem 3.5% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.000 KB) [ Info: All tests on worker 2 completed. Closing Worker(pid=497). [ Info: All tests on worker 1 completed. Closing Worker(pid=495). Worker 497: [497] signal 15: Terminated Worker 495: [495] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 505: [ Info: Starting test worker 1 on pid = 505, with 2 threads Worker 506: [ Info: Starting test worker 2 on pid = 506, with 2 threads [ Info: Starting running test items Worker 505: 06:15:22 | maxrss 2.1% | mem 3.5% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 506: 06:15:22 | maxrss 2.1% | mem 3.5% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 505: 06:15:25 | maxrss 2.1% | mem 3.5% | DONE (1/3) test item "happy 1" 0.3 secs (92.5% compile), 20.85 K allocs (1.095 MB) Worker 506: 06:15:25 | maxrss 2.1% | mem 3.5% | DONE (2/3) test item "happy 2" 0.3 secs (93.2% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 505 Error in testset "happy 1" on worker 505: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 506 Error in testset "happy 2" on worker 506: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 505: 06:15:27 | maxrss 2.1% | mem 3.5% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 505: 06:15:27 | maxrss 2.1% | mem 3.5% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.760 KB) [ Info: All tests on worker 2 completed. Closing Worker(pid=506). Worker 506: [506] signal 15: Terminated No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 505 Error in testset "happy 3" on worker 505: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=505). Worker 505: [505] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 515: [ Info: Starting test worker 1 on pid = 515, with 2 threads [ Info: Starting running test items Worker 515: 06:15:41 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 515: 06:15:42 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.2% compile), 21.33 K allocs (1.121 MB) Worker 515: 06:15:42 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 515: 06:15:42 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.05 K allocs (100.448 KB) Worker 515: 06:15:43 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 515: 06:15:43 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.05 K allocs (100.416 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=515). Worker 515: [515] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 15.4s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 520: [ Info: Starting test worker 1 on pid = 520, with 2 threads [ Info: Starting running test items Worker 520: 06:15:59 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 520: 06:16:00 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.4 secs (95.4% compile), 58.57 K allocs (3.270 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 520 Error in testset "post-testitem" on worker 520: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 520: 06:16:01 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 520: 06:16:01 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.02 K allocs (138.656 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 520 Error in testset "post-testitem" on worker 520: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 520: 06:16:03 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 520: 06:16:03 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.02 K allocs (138.656 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 520 Error in testset "post-testitem" on worker 520: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=520). Worker 520: [520] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 19.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 19.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 525: [ Info: Starting test worker 1 on pid = 525, with 2 threads [ Info: Starting running test items Worker 525: 06:16:19 | maxrss 2.1% | mem 2.7% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 525: 06:16:19 | maxrss 2.1% | mem 2.7% | DONE (1/2) test item "correct usage" 0.3 secs (96.3% compile), 61.47 K allocs (3.217 MB) Worker 525: 06:16:20 | maxrss 2.1% | mem 2.7% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 525: 06:16:20 | maxrss 2.1% | mem 2.7% | DONE (2/2) test item "incorrect usage" <0.1 secs (71.8% compile), 2.89 K allocs (149.736 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=525). Worker 525: [525] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 530: [ Info: Starting test worker 1 on pid = 530, with 2 threads [ Info: Starting running test items Worker 530: 06:16:35 | maxrss 2.1% | mem 2.8% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 530: 06:16:36 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "correct usage" 0.7 secs (97.1% compile, 7.0% GC), 212.35 K allocs (11.377 MB) Worker 530: 06:16:37 | maxrss 2.1% | mem 2.8% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 530: 06:16:38 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "incorrect usage" <0.1 secs (54.7% compile), 4.66 K allocs (222.400 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 530 Error in testset "no pins left at end of test" on worker 530: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1198 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=530). Worker 530: [530] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 9 tests on pid 19 06:16:39 | maxrss 2.1% | mem 2.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 06:16:39 | maxrss 2.1% | mem 2.0% | DONE (1/9) test item "do_thing Pass" 0.2 secs (95.6% compile, 71.1% recompile), 64.08 K allocs (3.586 MB) 06:16:39 | maxrss 2.1% | mem 2.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 06:16:39 | maxrss 2.1% | mem 2.0% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.50 K allocs (121.792 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 19 [ Info: RUNNING Error in testset "do_thing Fail" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.21620732093625972, 0.8610257724270033, 0.2321752186437812] == 1 06:16:39 | maxrss 2.1% | mem 2.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 06:16:40 | maxrss 2.1% | mem 2.1% | DONE (3/9) test item "do_thing Error" 0.8 secs (<0.1% compile), 259.23 K allocs (23.834 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 19 [ Info: RUNNING Error in testset "do_thing Error" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 06:16:40 | maxrss 2.1% | mem 2.1% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 06:16:40 | maxrss 2.1% | mem 2.1% | DONE (4/9) test item "bad setup, good test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 19 Error in testset "bad setup, good test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 06:16:40 | maxrss 2.1% | mem 2.1% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 06:16:41 | maxrss 2.1% | mem 2.1% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 19 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 19 Error in testset "bad setup, bad test" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 06:16:41 | maxrss 2.1% | mem 2.1% | START (6/9) test item "errors" at test/error_tests.jl:1 06:16:42 | maxrss 2.1% | mem 2.1% | DONE (6/9) test item "errors" 1.0 secs (<0.1% compile), 25.23 K allocs (1.879 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 19 [ Info: RUNNING Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#883"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#883"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [32] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [33] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [35] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [48] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [49] include @ ./sysimg.jl:38 [inlined] [50] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [51] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [52] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [54] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [55] include(fname::String) @ Main ./sysimg.jl:38 06:16:42 | maxrss 2.1% | mem 2.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 06:16:42 | maxrss 2.1% | mem 2.1% | DONE (7/9) test item "errors at the top level" 0.3 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 19 [ Info: RUNNING Error in testset "errors at the top level" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 06:16:42 | maxrss 2.1% | mem 2.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 06:16:42 | maxrss 2.1% | mem 2.1% | DONE (8/9) test item "nonexistent test setup" 0.3 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 19 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 19: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [23] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [24] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [26] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [31] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [40] include @ ./sysimg.jl:38 [inlined] [41] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [42] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [45] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [46] include(fname::String) @ Main ./sysimg.jl:38 [47] top-level scope @ none:6 06:16:42 | maxrss 2.1% | mem 2.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 06:16:42 | maxrss 2.1% | mem 2.1% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.57 K allocs (169.976 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 19 [ Info: RUNNING Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.24977145075054769 < 0 Error in testset "failures" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 3.4s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.2s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.8s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.4s bad setup, bad test | 1 1 0.4s test/error_tests.jl | 1 6 7 errors | 4 4 1.0s UndefVarError | 2 2 0.6s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.3s nonexistent test setup | 1 1 0.3s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1270. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 6 tests on pid 19 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 580: [ Info: Starting test worker 1 on pid = 580, with 2 threads [ Info: Starting running test items Worker 580: 06:19:19 | maxrss 2.2% | mem 2.9% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 580: 06:19:19 | maxrss 2.2% | mem 2.9% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (93.5% compile), 20.62 K allocs (1.093 MB) Worker 580: 06:19:20 | maxrss 2.2% | mem 2.9% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 580: 06:19:21 | maxrss 2.2% | mem 2.9% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.97 K allocs (98.096 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 580 Error in testset "skip false, 1 pass, 1 fail" on worker 580: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl:8 Expression: false Worker 580: 06:19:21 | maxrss 2.2% | mem 2.9% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 580: 06:19:21 | maxrss 2.2% | mem 2.9% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 580: 06:19:21 | maxrss 2.2% | mem 2.9% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.97 K allocs (97.976 KB) Worker 580: 06:19:22 | maxrss 2.2% | mem 2.9% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 580: 06:19:23 | maxrss 2.2% | mem 2.9% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=580). Worker 580: [580] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 20.5s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1280 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl 06:19:33 | maxrss 2.2% | mem 2.6% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Test Summary: | Fail Total Time should fail | 1 1 4.6s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 596: [ Info: Starting test worker 2 on pid = 596, with 2 threads\n Worker 597: [ Info: Starting test worker 3 on pid = 597, with 2 threads\n Worker 594: [ Info: Starting test worker 1 on pid = 594, with 2 threads\n[ Info: Starting running test items\n Worker 594: [594] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x779ab64a1f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 597: [597] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f9681220f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 596: [596] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x792e432e6f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 596\n┌ Error: Worker(pid=596, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 594\n┌ Error: Worker(pid=594, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 597\n┌ Error: Worker(pid=597, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 609: [ Info: Starting test worker on pid = 609, with 2 threads\n Worker 611: [ Info: Starting test worker on pid = 611, with 2 threads\n Worker 612: [ Info: Starting test worker on pid = 612, with 2 threads\n Worker 611: [611] signal 15: Terminated\nin expression starting at none:1\n\n Worker 609: [609] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f34e3f85f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 612: [612] signal 15: Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 611\n┌ Error: Worker(pid=611, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=611, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 609\n┌ Error: Worker(pid=609, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=609, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 612\n┌ Error: Worker(pid=612, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=612, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 669: [ Info: Starting test worker 1 on pid = 669, with 2 threads\n Worker 672: [ Info: Starting test worker 3 on pid = 672, with 2 threads\n Worker 671: [ Info: Starting test worker 2 on pid = 671, with 2 threads\n[ Info: Starting running test items\n Worker 672: [672] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7af334d47f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 671: [671] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x798fdf7b1f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 669: [669] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7b9f2a936f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 669\n┌ Error: Worker(pid=669, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 672\n\n┌ Error: Worker(pid=672, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\nNo Captured Logs[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 671\n┌ Error: Worker(pid=671, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 684: [ Info: Starting test worker on pid = 684, with 2 threads\n Worker 686: [ Info: Starting test worker on pid = 686, with 2 threads\n Worker 687: [ Info: Starting test worker on pid = 687, with 2 threads\n Worker 684: [684] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c47c7142193)\n__libc_free at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n_ZN4llvm20MachineDominatorTree13releaseMemoryEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm13PMDataManager8freePassEPNS_4PassENS_9StringRefENS_19PassDebuggingStringE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm13PMDataManager16removeDeadPassesEPNS_4PassENS_9StringRefENS_19PassDebuggingStringE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 687: [687] signal 15: Terminated\nin expression starting at none:1\n\n Worker 686: [686] signal 15: Terminated\nin expression starting at none:1\n_ZN15LiveDebugValues16InstrRefBasedLDV17buildMLocValueMapERN4llvm15MachineFunctionERSt10unique_ptrIA_S4_IA_NS_10ValueIDNumESt14default_deleteIS6_EES7_ISA_EESD_RNS1_15SmallVectorImplINS1_13SmallDenseMapINS_6LocIdxES5_Lj4ENS1_12DenseMapInfoISG_vEENS1_6detail12DenseMapPairISG_S5_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN15LiveDebugValues16InstrRefBasedLDV12ExtendRangesERN4llvm15MachineFunctionEPNS1_20MachineDominatorTreeEPNS1_16TargetPassConfigEjj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 684\n┌ Error: Worker(pid=684, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=684, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 687\n┌ Error: Worker(pid=687, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=687, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 686\n┌ Error: Worker(pid=686, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=686, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 19 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 711: [ Info: Starting test worker 2 on pid = 711, with 2 threads\n Worker 709: [ Info: Starting test worker 1 on pid = 709, with 2 threads\n Worker 712: [ Info: Starting test worker 3 on pid = 712, with 2 threads\n[ Info: Starting running test items\n Worker 709: [709] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm12MachineInstr10addOperandERNS_15MachineFunctionERKNS_14MachineOperandE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\nunknown function (ip: 0x7bb0347faadf)\nunknown function (ip: (nil))\nepoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n\n Worker 712: [712] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x74cca5fdaf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 711: [711] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7097b30a9f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\n\nNo Captured LogsNo Captured Logs for test item \"bad\" at for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:4test/testfiles/_failfast_crash_tests.jl:7 on worker 711\n┌ Error: Worker(pid=711, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n on worker 712[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\n┌ Error: Worker(pid=712, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 709\n┌ Error: Worker(pid=709, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 725: [ Info: Starting test worker on pid = 725, with 2 threads\n Worker 724: [ Info: Starting test worker on pid = 724, with 2 threads\n Worker 728: [ Info: Starting test worker on pid = 728, with 2 threads\n Worker 725: [725] signal 15: Terminated\nin expression starting at none:1\n\n Worker 728: [728] signal 15: Terminated\nin expression starting at none:1\n\n Worker 724: [724] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm7GVNPass17propagateEqualityEPNS_5ValueES2_RKNS_14BasicBlockEdgeEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 725\n┌ Error: Worker(pid=725, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=725, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 728\n┌ Error: Worker(pid=728, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 1 completed. Closing Worker(pid=728, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 724\n┌ Error: Worker(pid=724, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=724, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 19 06:27:26 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 06:27:26 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 19 Error in testset "test set" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 19 06:27:29 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 06:27:29 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 19 Error in testset "Failure at toplevel" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 06:27:29 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 06:27:29 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 19 Error in testset "Bar" on worker 19: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. 06:27:41 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:8 06:27:42 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" 0.2 secs (95.8% compile), 61.56 K allocs (3.631 MB) 06:27:42 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:21 06:27:42 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" <0.1 secs, 1.36 K allocs (207.584 KB) 06:27:42 | maxrss 2.3% | mem 2.8% | START test item "uses printstyled" at _test_log_capture.jl:34 06:27:43 | maxrss 2.3% | mem 2.8% | DONE test item "uses printstyled" 0.3 secs (98.3% compile), 273.23 K allocs (15.401 MB) 06:27:43 | maxrss 2.3% | mem 2.8% | START test item "uses @error" at _test_log_capture.jl:47 06:27:46 | maxrss 2.3% | mem 2.9% | DONE test item "uses @error" 2.5 secs (99.6% compile, 0.8% GC), 1.27 M allocs (68.749 MB) 06:27:46 | maxrss 2.3% | mem 2.9% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 06:27:46 | maxrss 2.3% | mem 2.9% | DONE test item "uses @test_logs @info" 0.3 secs (95.4% compile), 40.87 K allocs (2.261 MB) 06:27:46 | maxrss 2.3% | mem 2.9% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 06:27:46 | maxrss 2.3% | mem 2.9% | DONE test item "uses @test_logs @error" <0.1 secs (82.5% compile), 16.73 K allocs (931.928 KB) 06:27:47 | maxrss 2.3% | mem 2.9% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 06:27:47 | maxrss 2.3% | mem 2.9% | DONE test item "uses redirect_stdout" 0.2 secs (94.4% compile), 49.59 K allocs (2.767 MB) 06:27:47 | maxrss 2.3% | mem 2.9% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 06:27:47 | maxrss 2.3% | mem 2.9% | DONE test item "uses redirect_stderr" 0.1 secs (94.1% compile), 30.68 K allocs (1.707 MB) 06:27:48 | maxrss 2.3% | mem 2.9% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 06:27:48 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (97.9% compile), 199.90 K allocs (11.133 MB) 06:27:48 | maxrss 2.3% | mem 2.9% | START test item "uses with_logger" at _test_log_capture.jl:149 06:27:48 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger" 0.1 secs (91.6% compile), 20.98 K allocs (1.217 MB) 06:27:49 | maxrss 2.3% | mem 2.9% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 06:27:49 | maxrss 2.3% | mem 2.9% | DONE test item "uses display" 0.8 secs (99.4% compile, 4.5% GC), 326.88 K allocs (16.349 MB) 06:27:50 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:184 06:27:51 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.45 K allocs (84.880 KB) 06:27:51 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:199 06:27:51 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.45 K allocs (84.592 KB) 06:27:51 | maxrss 2.3% | mem 2.9% | START test item "setup uses printstyled" at _test_log_capture.jl:214 06:27:51 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses printstyled" <0.1 secs, 1.45 K allocs (84.592 KB) 06:27:51 | maxrss 2.3% | mem 2.9% | START test item "setup uses @error" at _test_log_capture.jl:229 06:27:51 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses @error" <0.1 secs, 1.45 K allocs (84.592 KB) 06:27:52 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 06:27:52 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.99 K allocs (105.536 KB) 06:27:52 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 06:27:52 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.99 K allocs (105.536 KB) 06:27:52 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 06:27:52 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.00 K allocs (106.712 KB) 06:27:53 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger" at _test_log_capture.jl:315 06:27:53 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger" <0.1 secs, 1.45 K allocs (86.224 KB) 06:27:53 | maxrss 2.3% | mem 2.9% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 06:27:53 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses display" <0.1 secs, 1.45 K allocs (84.592 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 15.8s 06:28:02 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:8 06:28:03 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" 0.1 secs (93.6% compile), 36.51 K allocs (2.032 MB) 06:28:03 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:21 06:28:03 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" <0.1 secs, 1.38 K allocs (77.952 KB) 06:28:03 | maxrss 2.3% | mem 2.8% | START test item "uses printstyled" at _test_log_capture.jl:34 06:28:03 | maxrss 2.3% | mem 2.8% | DONE test item "uses printstyled" <0.1 secs (67.7% compile), 1.45 K allocs (81.672 KB) 06:28:03 | maxrss 2.3% | mem 2.8% | START test item "uses @error" at _test_log_capture.jl:47 06:28:06 | maxrss 2.3% | mem 2.8% | DONE test item "uses @error" 2.8 secs (99.7% compile, 6.5% GC), 1.26 M allocs (68.127 MB) 06:28:06 | maxrss 2.3% | mem 2.8% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 06:28:06 | maxrss 2.3% | mem 2.8% | DONE test item "uses @test_logs @info" 0.3 secs (95.3% compile), 40.92 K allocs (2.264 MB) 06:28:06 | maxrss 2.3% | mem 2.8% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 06:28:06 | maxrss 2.3% | mem 2.8% | DONE test item "uses @test_logs @error" <0.1 secs (81.2% compile), 16.77 K allocs (934.232 KB) 06:28:06 | maxrss 2.3% | mem 2.8% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 06:28:06 | maxrss 2.3% | mem 2.8% | DONE test item "uses redirect_stdout" 0.2 secs (94.8% compile), 49.77 K allocs (2.775 MB) 06:28:06 | maxrss 2.3% | mem 2.8% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 06:28:06 | maxrss 2.3% | mem 2.8% | DONE test item "uses redirect_stderr" 0.2 secs (94.1% compile), 30.72 K allocs (1.709 MB) 06:28:06 | maxrss 2.3% | mem 2.8% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 06:28:07 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (97.7% compile, 2.9% GC), 199.94 K allocs (11.136 MB) 06:28:07 | maxrss 2.3% | mem 2.9% | START test item "uses with_logger" at _test_log_capture.jl:149 06:28:07 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger" <0.1 secs (89.9% compile), 22.70 K allocs (1.297 MB) 06:28:07 | maxrss 2.3% | mem 2.9% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 06:28:08 | maxrss 2.3% | mem 2.9% | DONE test item "uses display" 1.1 secs (99.3% compile), 607.27 K allocs (32.043 MB) 06:28:08 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:184 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:199 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses printstyled" at _test_log_capture.jl:214 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses printstyled" <0.1 secs, 1.49 K allocs (86.736 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses @error" at _test_log_capture.jl:229 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses @error" <0.1 secs, 1.49 K allocs (86.984 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.04 K allocs (108.992 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger" at _test_log_capture.jl:315 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger" <0.1 secs, 1.49 K allocs (86.736 KB) 06:28:09 | maxrss 2.3% | mem 2.9% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 06:28:09 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses display" <0.1 secs, 1.49 K allocs (86.696 KB) Test Summary: | Pass Broken Total  Time log capture logs=:batched |  26  2  28 10.6s 06:28:18 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:8 06:28:19 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" 0.1 secs (93.4% compile), 36.51 K allocs (2.032 MB) 06:28:19 | maxrss 2.3% | mem 2.8% | START test item "uses println" at _test_log_capture.jl:21 06:28:19 | maxrss 2.3% | mem 2.8% | DONE test item "uses println" <0.1 secs, 1.38 K allocs (77.952 KB) 06:28:19 | maxrss 2.3% | mem 2.8% | START test item "uses printstyled" at _test_log_capture.jl:34 06:28:19 | maxrss 2.3% | mem 2.8% | DONE test item "uses printstyled" <0.1 secs (68.2% compile), 1.45 K allocs (81.672 KB) 06:28:19 | maxrss 2.3% | mem 2.8% | START test item "uses @error" at _test_log_capture.jl:47 06:28:21 | maxrss 2.3% | mem 2.8% | DONE test item "uses @error" 2.7 secs (99.7% compile, 6.7% GC), 1.26 M allocs (68.128 MB) 06:28:21 | maxrss 2.3% | mem 2.8% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 06:28:22 | maxrss 2.3% | mem 2.8% | DONE test item "uses @test_logs @info" 0.3 secs (95.3% compile), 40.92 K allocs (2.264 MB) 06:28:22 | maxrss 2.3% | mem 2.8% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 06:28:22 | maxrss 2.3% | mem 2.8% | DONE test item "uses @test_logs @error" <0.1 secs (82.8% compile), 16.77 K allocs (934.232 KB) 06:28:22 | maxrss 2.3% | mem 2.8% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 06:28:22 | maxrss 2.3% | mem 2.8% | DONE test item "uses redirect_stdout" 0.2 secs (95.1% compile), 49.77 K allocs (2.775 MB) 06:28:22 | maxrss 2.3% | mem 2.8% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 06:28:22 | maxrss 2.3% | mem 2.8% | DONE test item "uses redirect_stderr" 0.2 secs (94.2% compile), 30.72 K allocs (1.709 MB) 06:28:22 | maxrss 2.3% | mem 2.8% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 06:28:23 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (97.8% compile, 2.7% GC), 199.94 K allocs (11.136 MB) 06:28:23 | maxrss 2.3% | mem 2.9% | START test item "uses with_logger" at _test_log_capture.jl:149 06:28:23 | maxrss 2.3% | mem 2.9% | DONE test item "uses with_logger" 0.1 secs (89.1% compile), 22.70 K allocs (1.297 MB) 06:28:23 | maxrss 2.3% | mem 2.9% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 06:28:24 | maxrss 2.3% | mem 2.9% | DONE test item "uses display" 1.1 secs (99.5% compile), 607.27 K allocs (32.044 MB) 06:28:24 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:184 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses println" at _test_log_capture.jl:199 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses println" <0.1 secs, 1.49 K allocs (86.696 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses printstyled" at _test_log_capture.jl:214 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses printstyled" <0.1 secs, 1.49 K allocs (86.736 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses @error" at _test_log_capture.jl:229 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses @error" <0.1 secs, 1.49 K allocs (86.984 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 2.03 K allocs (107.696 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 2.04 K allocs (108.992 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses with_logger" at _test_log_capture.jl:315 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses with_logger" <0.1 secs, 1.49 K allocs (86.736 KB) 06:28:25 | maxrss 2.3% | mem 2.9% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 06:28:25 | maxrss 2.3% | mem 2.9% | DONE test item "setup uses display" <0.1 secs, 1.49 K allocs (86.696 KB) Test Summary: | Pass Broken Total  Time log capture logs=:issues |  26  2  28 10.4s Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 5.82 seconds. Scheduling 6 tests on pid 769 06:29:17 | maxrss 2.3% | mem 3.1% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 06:29:18 | maxrss 2.3% | mem 3.1% | DONE (1/6) test item "testitem1" 0.2 secs (94.3% compile), 29.91 K allocs (1.585 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 769 Error in testset "testitem1" on worker 769: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 06:29:19 | maxrss 2.3% | mem 3.1% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 06:29:19 | maxrss 2.3% | mem 3.1% | DONE (2/6) test item "testitem2" 0.3 secs (93.9% compile), 48.13 K allocs (2.724 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 769 Error in testset "inner testset" on worker 769: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 769: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" 06:29:19 | maxrss 2.3% | mem 3.1% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 06:29:19 | maxrss 2.3% | mem 3.1% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 2.03 K allocs (99.896 KB) 06:29:19 | maxrss 2.3% | mem 3.1% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 06:29:22 | maxrss 2.3% | mem 3.2% | DONE (4/6) test item "testitem4" 3.4 secs (90.5% compile, 2.4% GC), 909.55 K allocs (52.055 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 769 Error in testset "nested testset" on worker 769: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined in `Main.var"##testitem4#242"` Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:430 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [13] open @ ./io.jl:407 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [19] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [20] with_logstate(f::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [24] #runtests#46 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:236 [inlined] [25] top-level scope @ none:1 06:29:22 | maxrss 2.3% | mem 3.2% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 06:29:23 | maxrss 2.3% | mem 3.2% | DONE (5/6) test item "testitem5" <0.1 secs (89.5% compile), 2.38 K allocs (114.504 KB) 06:29:23 | maxrss 2.3% | mem 3.2% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 06:29:23 | maxrss 2.3% | mem 3.2% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.88 K allocs (133.904 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 769 Error in testset "testitem6" on worker 769: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_86askR/report-ReTestItems-20250629-062917.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 10.1s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 0.2s testitem2 | 1 1 1 3 0.3s inner testset | 1 1 2 0.1s testitem3 | 2 2 0.0s testitem4 | 1 1 3.4s nested testset | 1 1 3.3s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 5.86 seconds. Scheduling 6 tests on pid 773 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 777 running 1 of 2 signal (10): User defined signal 1 unknown function (ip: 0x7dcfe643ff14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 profile_printing_listener at ./Base.jl:582 #1190 at ./Base.jl:622 jfptr_YY.1190_76268.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) _ZN4llvm12InstrEmitter18AddRegisterOperandERNS_19MachineInstrBuilderENS_7SDValueEjPKNS_11MCInstrDescERNS_8DenseMapIS3_NS_8RegisterENS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_S8_EEEEbbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm12InstrEmitter15EmitMachineNodeEPNS_6SDNodeEbbRNS_8DenseMapINS_7SDValueENS_8RegisterENS_12DenseMapInfoIS4_vEENS_6detail12DenseMapPairIS4_S5_EEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZZN4llvm18ScheduleDAGSDNodes12EmitScheduleERNS_26MachineInstrBundleIteratorINS_12MachineInstrELb0EEEENKUlPNS_6SDNodeEbbRNS_8DenseMapINS_7SDValueENS_8RegisterENS_12DenseMapInfoIS8_vEENS_6detail12DenseMapPairIS8_S9_EEEEE_clES6_bbSG_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm18ScheduleDAGSDNodes12EmitScheduleERNS_26MachineInstrBundleIteratorINS_12MachineInstrELb0EEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel17CodeGenAndEmitDAGEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel20SelectAllBasicBlocksERKNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16SelectionDAGISel20runOnMachineFunctionERNS_15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_115X86DAGToDAGISel20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) operator() at /source/src/jitlayers.cpp:1388 _ZN4llvm3orc14IRCompileLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc19MaterializationTask3runEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_vEEEENSG_ISD_vEENS_6detail12DenseMapPairISD_SI_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_vEENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_vEENSN_IS6_SV_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EENS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISI_vEEEENSJ_IS5_vEENS_6detail12DenseMapPairIS5_SL_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) addModule at /source/src/jitlayers.cpp:1875 jl_add_to_ee at /source/src/jitlayers.cpp:2306 jl_add_to_ee at /source/src/jitlayers.cpp:2285 jl_add_to_ee at /source/src/jitlayers.cpp:2285 _jl_compile_codeinst at /source/src/jitlayers.cpp:277 jl_generate_fptr_impl at /source/src/jitlayers.cpp:536 jl_compile_method_internal at /source/src/gf.c:2536 [inlined] jl_compile_method_internal at /source/src/gf.c:2423 _jl_invoke at /source/src/gf.c:2940 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] exec_options at ./client.jl:296 _start at ./client.jl:531 jfptr__start_73694.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] true_main at /source/src/jlapi.c:900 jl_repl_entrypoint at /source/src/jlapi.c:1059 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7dcfe63e1249) __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 773 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] fetch_buffered at ./channels.jl:447 fetch at ./channels.jl:441 [inlined] fetch at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:51 [inlined] remote_fetch at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:294 [inlined] #start_worker#65 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:484 start_worker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:480 unknown function (ip: 0x7184bd199a89) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_apply at /source/src/builtins.c:831 #106#107 at ./error.jl:300 #106 at ./error.jl:295 [inlined] #robust_start_worker#66 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:511 [inlined] robust_start_worker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:509 [inlined] #56 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:435 [inlined] with_logstate at ./logging/logging.jl:524 with_logger at ./logging/logging.jl:635 [inlined] #55 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:434 unknown function (ip: 0x7184bd18bcbf) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x0000718497cc4010 Total snapshots: 337. Utilization: 0% ╎337 …ems/src/ReTestItems.jl:434; (::ReTestItems.var"#55#60"{Base.CoreLoggin… ╎ 337 …ase/logging/logging.jl:635; with_logger ╎ 337 …se/logging/logging.jl:524; with_logstate(f::ReTestItems.var"#56#61"{… ╎ 337 …ms/src/ReTestItems.jl:435; #56 ╎ 337 …ms/src/ReTestItems.jl:509; robust_start_worker ╎ 337 …s/src/ReTestItems.jl:511; #robust_start_worker#66 ╎ ╎ 337 @Base/error.jl:295; #106 ╎ ╎ 337 @Base/error.jl:300; (::Base.var"#106#108"{Base.var"#106#107#109"… ╎ ╎ 337 …/src/ReTestItems.jl:480; kwcall(::@NamedTuple{worker_num::Int6… ╎ ╎ 337 …/src/ReTestItems.jl:484; start_worker(proj_name::String, nwor… ╎ ╎ 337 …ems/src/workers.jl:294; remote_fetch ╎ ╎ ╎ 337 …ems/src/workers.jl:51; fetch ╎ ╎ ╎ 337 @Base/channels.jl:441; fetch ╎ ╎ ╎ 337 @Base/channels.jl:447; fetch_buffered(c::Channel{Any}) ╎ ╎ ╎ 337 @Base/condition.jl:125; wait ╎ ╎ ╎ 337 …ase/condition.jl:130; wait(c::Base.GenericCondition{Ree… ╎ ╎ ╎ ╎ 337 @Base/task.jl:1021; wait() 336╎ ╎ ╎ ╎ 337 @Base/task.jl:1012; poptask(W::Base.IntrusiveLinkedLis… Worker 777: ┌ Warning: There were no samples collected in one or more groups. Worker 777: │ This may be due to idle threads, or you may need to run your Worker 777: │ program longer (perhaps by running it multiple times), Worker 777: │ or adjust the delay between samples with `Profile.init()`. Worker 777: └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Worker 777: Overhead ╎ [+additional indent] Count File:Line; Function Worker 777: ========================================================= Worker 777: Thread 1 Task 0x00007dcfd8e00010 Total snapshots: 1. Utilization: 100% Worker 777: ╎1 @Base/client.jl:531; _start() Worker 777: ╎ 1 @Base/client.jl:296; exec_options(opts::Base.JLOptions) Worker 777: ╎ 1 @Base/boot.jl:430; eval Worker 777: Thread 2 Task 0x00007dcfd8e001a0 Total snapshots: 1. Utilization: 0% Worker 777: ╎1 @Base/Base.jl:622; (::Base.var"#1190#1193"{Base.AsyncCondition})() Worker 777: ╎ 1 @Base/Base.jl:582; profile_printing_listener(cond::Base.AsyncCondition) Worker 777: ╎ 1 @Base/asyncevent.jl:145; _trywait(t::Base.AsyncCondition) Worker 777: ╎ 1 @Base/condition.jl:125; wait Worker 777: ╎ 1 @Base/condition.jl:130; wait(c::Base.GenericCondition{Base.Threads.Spin… Worker 777: ╎ 1 @Base/task.jl:1021; wait() Worker 777: ╎ ╎ 1 @Base/task.jl:1012; poptask(W::Base.IntrusiveLinkedListSynchronized{T… Worker 777: [ Info: Starting test worker 1 on pid = 777, with 2 threads [ Info: Starting running test items Worker 777: 06:30:27 | maxrss 1.8% | mem 4.2% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 Worker 777: 06:30:28 | maxrss 1.8% | mem 4.2% | DONE (1/6) test item "testitem1" 0.2 secs (93.1% compile), 20.83 K allocs (1.095 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 777 Error in testset "testitem1" on worker 777: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 Worker 777: 06:30:30 | maxrss 1.8% | mem 4.2% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 Worker 777: 06:30:30 | maxrss 1.8% | mem 4.2% | DONE (2/6) test item "testitem2" 0.2 secs (93.7% compile), 48.13 K allocs (2.725 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 777 Error in testset "inner testset" on worker 777: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 777: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" Worker 777: 06:30:32 | maxrss 1.8% | mem 4.2% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 Worker 777: 06:30:32 | maxrss 1.8% | mem 4.2% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 2.03 K allocs (100.024 KB) Worker 777: 06:30:33 | maxrss 1.8% | mem 4.2% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 19 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] wait at ./process.jl:694 wait at ./process.jl:687 [inlined] success at ./process.jl:556 [inlined] #run#899 at ./process.jl:513 run at ./process.jl:510 [inlined] #460 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:84 withenv at ./env.jl:265 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_invoke at /source/src/gf.c:2955 #459 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:82 [inlined] #mktempdir#28 at ./file.jl:819 unknown function (ip: 0x79bad824ad6d) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 mktempdir at ./file.jl:815 mktempdir at ./file.jl:815 unknown function (ip: 0x79bad8249e02) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 _include at ./loading.jl:2794 include at ./sysimg.jl:38 [inlined] #2 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:33 withenv at ./env.jl:265 unknown function (ip: 0x79baef09be13) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 _include at ./loading.jl:2794 include at ./sysimg.jl:38 unknown function (ip: 0x79baef093082) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] exec_options at ./client.jl:296 _start at ./client.jl:531 jfptr__start_73694.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] true_main at /source/src/jlapi.c:900 jl_repl_entrypoint at /source/src/jlapi.c:1059 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x79baf0144249) __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x000079bae2a00010 Total snapshots: 210. Utilization: 0% ╎210 @Base/client.jl:531; _start() ╎ 210 @Base/client.jl:296; exec_options(opts::Base.JLOptions) ╎ 210 @Base/boot.jl:430; eval ╎ 210 @Base/sysimg.jl:38; include(fname::String) ╎ 210 @Base/loading.jl:2794; _include(mapexpr::Function, mod::Module, _pa… ╎ 210 @Base/loading.jl:2734; include_string(mapexpr::typeof(identity), m… ╎ ╎ 210 @Base/boot.jl:430; eval ╎ ╎ 210 @Base/env.jl:265; withenv(f::var"#2#4", keyvals::Pair{String, In… ╎ ╎ 210 …ms/test/runtests.jl:33; (::var"#2#4")() ╎ ╎ 210 @Base/sysimg.jl:38; include ╎ ╎ 210 @Base/loading.jl:2794; _include(mapexpr::Function, mod::Modul… ╎ ╎ ╎ 210 @Base/loading.jl:2734; include_string(mapexpr::typeof(identi… ╎ ╎ ╎ 210 @Base/boot.jl:430; eval ╎ ╎ ╎ 210 @Base/file.jl:815; mktempdir(fn::Function) ╎ ╎ ╎ 210 @Base/file.jl:815; mktempdir(fn::Function, parent::String) ╎ ╎ ╎ 210 @Base/file.jl:819; mktempdir(fn::var"#459#476"{String, I… ╎ ╎ ╎ ╎ 210 …est/junit_xml.jl:82; #459 ╎ ╎ ╎ ╎ 210 @Base/env.jl:265; withenv(::var"#460#477"{String, Stri… ╎ ╎ ╎ ╎ 210 …st/junit_xml.jl:84; (::var"#460#477"{String, String}… ╎ ╎ ╎ ╎ 210 @Base/process.jl:510; run ╎ ╎ ╎ ╎ 210 …ase/process.jl:513; run(::Cmd; wait::Bool) ╎ ╎ ╎ ╎ ╎ 210 …ase/process.jl:556; success ╎ ╎ ╎ ╎ ╎ 210 …se/process.jl:687; wait ╎ ╎ ╎ ╎ ╎ 210 …se/process.jl:694; wait(x::Base.Process, syncd:… ╎ ╎ ╎ ╎ ╎ 210 …/condition.jl:125; wait ╎ ╎ ╎ ╎ ╎ 210 …condition.jl:130; wait(c::Base.GenericConditi… ╎ ╎ ╎ ╎ ╎ ╎ 210 …ase/task.jl:1021; wait() 209╎ ╎ ╎ ╎ ╎ ╎ 210 …ase/task.jl:1012; poptask(W::Base.Intrusive… Worker 777: 06:30:37 | maxrss 1.9% | mem 4.3% | DONE (4/6) test item "testitem4" 4.0 secs (97.0% compile), 875.90 K allocs (49.982 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 777 Error in testset "nested testset" on worker 777: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined in `Main.var"##testitem4#236"` Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:430 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [13] open @ ./io.jl:407 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] top-level scope @ none:1 Worker 777: 06:30:38 | maxrss 1.9% | mem 4.3% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 Worker 777: 06:30:38 | maxrss 1.9% | mem 4.3% | DONE (5/6) test item "testitem5" <0.1 secs (90.2% compile), 2.41 K allocs (115.640 KB) Worker 777: 06:30:39 | maxrss 1.9% | mem 4.3% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 Worker 777: 06:30:39 | maxrss 1.9% | mem 4.3% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.89 K allocs (134.080 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 777 Error in testset "testitem6" on worker 777: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=777). Worker 777: [777] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7dcfe643ff14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_Pw0vdM/report-ReTestItems-20250629-063027.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 49.9s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 0.2s testitem2 | 1 1 1 3 0.2s inner testset | 1 1 2 0.1s testitem3 | 2 2 0.0s testitem4 | 1 1 4.0s nested testset | 1 1 4.0s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) ERROR: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] wait at ./process.jl:694 wait at ./process.jl:687 unknown function (ip: 0x7733e3b180a2) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 subprocess_handler at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2146 #131 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2086 withenv at ./env.jl:265 #118 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1935 with_temp_env at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1793 #116 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1902 #mktempdir#28 at ./file.jl:819 unknown function (ip: 0x7733e3b0e3fd) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 mktempdir at ./file.jl:815 mktempdir at ./file.jl:815 [inlined] #sandbox#115 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1849 [inlined] sandbox at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1841 unknown function (ip: 0x7733e3b0298a) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 #test#128 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2067 test at /source/usr/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2011 [inlined] #test#146 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 test at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:460 unknown function (ip: 0x7733e3b0268d) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 #test#77 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 unknown function (ip: 0x7733e3b0207d) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 test at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:148 #test#75 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] test at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] #test#74 at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] test at /source/usr/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 unknown function (ip: 0x7733e3afe506) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 _include at ./loading.jl:2794 Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. include at ./Base.jl:562 jfptr_include_47034.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 exec_options at ./client.jl:323 _start at ./client.jl:531 jfptr__start_73694.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] true_main at /source/src/jlapi.c:900 jl_repl_entrypoint at /source/src/jlapi.c:1059 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x7733e4b32249) __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.11/Profile/src/Profile.jl:1240 Overhead ╎ [+additional indent] Count File:Line; Function ========================================================= Thread 1 Task 0x00007733d7400010 Total snapshots: 24. Utilization: 0% ╎24 @Base/client.jl:531; _start() ╎ 24 @Base/client.jl:323; exec_options(opts::Base.JLOptions) ╎ 24 @Base/Base.jl:562; include(mod::Module, _path::String) ╎ 24 @Base/loading.jl:2794; _include(mapexpr::Function, mod::Module, _path:… ╎ 24 @Base/loading.jl:2734; include_string(mapexpr::typeof(identity), mod:… ╎ 24 @Base/boot.jl:430; eval ╎ ╎ 24 @Pkg/src/API.jl:146; kwcall(::@NamedTuple{julia_args::Cmd}, ::typeo… ╎ ╎ 24 @Pkg/src/API.jl:146; #test#74 ╎ ╎ 24 @Pkg/src/API.jl:147; test ╎ ╎ 24 @Pkg/src/API.jl:147; #test#75 ╎ ╎ 24 @Pkg/src/API.jl:148; kwcall(::@NamedTuple{julia_args::Cmd}, ::t… ╎ ╎ ╎ 24 @Pkg/src/API.jl:159; test(pkgs::Vector{Pkg.Types.PackageSpec};… ╎ ╎ ╎ 24 @Pkg/src/API.jl:460; kwcall(::@NamedTuple{julia_args::Cmd, io… ╎ ╎ ╎ 24 @Pkg/src/API.jl:481; test(ctx::Pkg.Types.Context, pkgs::Vect… ╎ ╎ ╎ 24 …src/Operations.jl:2011; test ╎ ╎ ╎ 24 …src/Operations.jl:2067; test(ctx::Pkg.Types.Context, pkgs… ╎ ╎ ╎ ╎ 24 …rc/Operations.jl:1841; kwcall(::@NamedTuple{preferences:… ╎ ╎ ╎ ╎ 24 …rc/Operations.jl:1849; #sandbox#115 ╎ ╎ ╎ ╎ 24 @Base/file.jl:815; mktempdir ╎ ╎ ╎ ╎ 24 @Base/file.jl:815; mktempdir(fn::Function, parent::Str… ╎ ╎ ╎ ╎ 24 @Base/file.jl:819; mktempdir(fn::Pkg.Operations.var"#… ╎ ╎ ╎ ╎ ╎ 24 …/Operations.jl:1902; (::Pkg.Operations.var"#116#121… ╎ ╎ ╎ ╎ ╎ 24 …/Operations.jl:1793; with_temp_env(fn::Pkg.Operati… ╎ ╎ ╎ ╎ ╎ 24 …Operations.jl:1935; (::Pkg.Operations.var"#118#12… ╎ ╎ ╎ ╎ ╎ 24 @Base/env.jl:265; withenv(::Pkg.Operations.var"#1… ╎ ╎ ╎ ╎ ╎ 24 …Operations.jl:2086; (::Pkg.Operations.var"#131#… ╎ ╎ ╎ ╎ ╎ ╎ 24 …perations.jl:2146; subprocess_handler(cmd::Cmd… ╎ ╎ ╎ ╎ ╎ ╎ 24 …e/process.jl:687; wait(x::Base.Process) ╎ ╎ ╎ ╎ ╎ ╎ 24 …e/process.jl:694; wait(x::Base.Process, sync… ╎ ╎ ╎ ╎ ╎ ╎ 24 …ondition.jl:125; wait ╎ ╎ ╎ ╎ ╎ ╎ 24 …ondition.jl:130; wait(c::Base.GenericCondi… ╎ ╎ ╎ ╎ ╎ ╎ ╎ 24 …ase/task.jl:1021; wait() 23╎ ╎ ╎ ╎ ╎ ╎ ╎ 24 …ase/task.jl:1012; poptask(W::Base.Intrus… [19] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:76 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 [782] signal 15: Terminated in expression starting at none:1 poptask at ./task.jl:1012 poptask at ./task.jl:1012 wait at ./task.jl:1021 wait at ./task.jl:1021 is_known_call at ./compiler/ssair/passes.jl:6 #wait#733 at ./condition.jl:130 #wait#733 at ./condition.jl:130 sroa_pass! at ./compiler/ssair/passes.jl:1323 wait at ./condition.jl:125 [inlined] wait at ./process.jl:694 wait at ./process.jl:687 [inlined] success at ./process.jl:556 [inlined] #run#899 at ./process.jl:513 run at ./process.jl:510 [inlined] #462 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:96 withenv at ./env.jl:265 wait at ./condition.jl:125 [inlined] _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_invoke at /source/src/gf.c:2955 #461 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:94 [inlined] _trywait at ./asyncevent.jl:145 #mktempdir#28 at ./file.jl:819 unknown function (ip: 0x79bad825747d) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 mktempdir at ./file.jl:815 mktempdir at ./file.jl:815 unknown function (ip: 0x79bad8249e02) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 run_passes_ipo_safe at ./compiler/optimize.jl:994 eval_body at /source/src/interpreter.c:539 profile_printing_listener at ./Base.jl:582 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 run_passes_ipo_safe at ./compiler/optimize.jl:1009 [inlined] optimize at ./compiler/optimize.jl:983 #1190 at ./Base.jl:622 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jfptr_YY.1190_76268.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) Allocations: 9777468 (Pool: 9777156; Big: 312); GC: 10 _include at ./loading.jl:2794 include at ./sysimg.jl:38 [inlined] #2 at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:33 withenv at ./env.jl:265 unknown function (ip: 0x79baef09be13) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 val already in a list atexit hook threw an error: ErrorException("schedule: Task not runnable"jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 ) eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 error at ./error.jl:35 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 #schedule#763 at ./task.jl:884 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2734 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 schedule at ./task.jl:876 [inlined] uv_writecb_task at ./stream.jl:1200 _include at ./loading.jl:2794 include at ./sysimg.jl:38 unknown function (ip: 0x79baef093082) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 jfptr_uv_writecb_task_67144.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 eval at ./boot.jl:430 [inlined] exec_options at ./client.jl:296 jlcapi_uv_writecb_task_67607.1 at /opt/julia/lib/julia/sys.so (unknown line) jfptr_optimize_42864.1 at /opt/julia/lib/julia/sys.so (unknown line) uv__write_callbacks at /workspace/srcdir/libuv/src/unix/stream.c:926 _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 uv__stream_io at /workspace/srcdir/libuv/src/unix/stream.c:1227 uv__run_pending at /workspace/srcdir/libuv/src/unix/core.c:824 uv_run at /workspace/srcdir/libuv/src/unix/core.c:420 ijl_task_get_next at /source/src/scheduler.c:522 _start at ./client.jl:531 finish_nocycle at ./compiler/typeinfer.jl:265 poptask at ./task.jl:1012 jfptr__start_73694.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] true_main at /source/src/jlapi.c:900 jl_repl_entrypoint at /source/src/jlapi.c:1059 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x79baf0144249) __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) unknown function (ip: (nil)) Allocations: 86011045 (Pool: 86004687; Big: 6358); GC: 144 _typeinf at ./compiler/typeinfer.jl:249 wait at ./task.jl:1021 val already in a list atexit hook threw an error: ErrorException("schedule: Task not runnable") typeinf at ./compiler/typeinfer.jl:215 uv_write at ./stream.jl:1081 error at ./error.jl:35 const_prop_call at ./compiler/abstractinterpretation.jl:1278 unsafe_write at ./stream.jl:1154 #schedule#763 at ./task.jl:884 abstract_call_method_with_const_args at ./compiler/abstractinterpretation.jl:853 write at ./strings/io.jl:248 [inlined] print at ./strings/io.jl:250 schedule at ./task.jl:876 [inlined] uv_writecb_task at ./stream.jl:1200 abstract_call_method_with_const_args at ./compiler/abstractinterpretation.jl:823 jfptr_print_48490.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 showerror at ./errorshow.jl:152 unknown function (ip: 0x7733e3b25156) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jfptr_uv_writecb_task_67144.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:111 _atexit at ./initdefs.jl:454 jlcapi_uv_writecb_task_67607.1 at /opt/julia/lib/julia/sys.so (unknown line) abstract_call_known at ./compiler/abstractinterpretation.jl:2200 uv__write_callbacks at /workspace/srcdir/libuv/src/unix/stream.c:926 uv__stream_io at /workspace/srcdir/libuv/src/unix/stream.c:1227 jfptr__atexit_69651.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2948 [inlined] ijl_apply_generic at /source/src/gf.c:3125 jl_apply at /source/src/julia.h:2157 [inlined] ijl_atexit_hook at /source/src/init.c:271 uv__run_pending at /workspace/srcdir/libuv/src/unix/core.c:824 uv_run at /workspace/srcdir/libuv/src/unix/core.c:420 ijl_task_get_next at /source/src/scheduler.c:522 jl_exit_thread0_cb at /source/src/signals-unix.c:517 abstract_call at ./compiler/abstractinterpretation.jl:2282 poptask at ./task.jl:1012 abstract_call at ./compiler/abstractinterpretation.jl:2275 wait at ./task.jl:1021 abstract_call at ./compiler/abstractinterpretation.jl:2423 uv_write at ./stream.jl:1081 abstract_eval_call at ./compiler/abstractinterpretation.jl:2438 unsafe_write at ./stream.jl:1154 abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2454 PkgEval terminated after 2752.41s: test duration exceeded the time limit