Package evaluation to test ReTestItems on Julia 1.11.7 (58327cce5e*) started at 2025-10-28T15:51:14.348 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.63s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [817f1d60] + ReTestItems v1.34.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [817f1d60] + ReTestItems v1.34.0 [1e6cf692] + TestEnv v1.102.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 1.33s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 15.64s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_14TxZH/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v1.0.0 [817f1d60] ReTestItems v1.34.0 [1e6cf692] TestEnv v1.102.2 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_14TxZH/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.3 [b5f81e59] IOCapture v1.0.0 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.1 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.5.0 [817f1d60] ReTestItems v1.34.0 [1e6cf692] TestEnv v1.102.2 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.15.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Worker 23: [23] signal 15: Terminated Worker 27: [27] signal 15: Terminated Worker 35: [35] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:152 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:152 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:156 15:53:17 | maxrss 1.3% | mem 1.4% | SKIP (0/1) test item "skip" at internals.jl:296 15:53:22 | maxrss 1.4% | mem 1.4% | START test item "TI1" at macros.jl:32 15:53:22 | maxrss 1.4% | mem 1.4% | DONE test item "TI1" 0.1 secs (96.2% compile), 70.67 K allocs (3.982 MB) 15:53:22 | maxrss 1.4% | mem 1.4% | START test item "TI2" at macros.jl:43 15:53:22 | maxrss 1.4% | mem 1.4% | DONE test item "TI2" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 15:53:22 | maxrss 1.4% | mem 1.4% | START test item "TI" at macros.jl:53 15:53:22 | maxrss 1.4% | mem 1.4% | DONE test item "TI" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 15:53:23 | maxrss 1.4% | mem 1.4% | START test item "macro-import" at macros.jl:64 15:53:25 | maxrss 1.4% | mem 1.4% | DONE test item "macro-import" 2.2 secs (99.4% compile), 822.50 K allocs (44.851 MB) 15:53:25 | maxrss 1.4% | mem 1.4% | START test item "Foo" at macros.jl:95 15:53:25 | maxrss 1.4% | mem 1.4% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.79 K allocs (132.776 KB) 15:53:26 | maxrss 1.4% | mem 1.4% | START test item "Foo3" at macros.jl:110 15:53:26 | maxrss 1.4% | mem 1.4% | DONE test item "Foo3" <0.1 secs (53.2% compile), 2.94 K allocs (144.952 KB) 15:53:26 | maxrss 1.4% | mem 1.4% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [5] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:109 [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [7] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [8] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [9] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1051 [10] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/macros.jl:123 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/macros.jl:118 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/macros.jl:23 [15] include @ ./sysimg.jl:38 [inlined] [16] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:20 [17] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [18] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [20] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [21] include(fname::String) @ Main ./sysimg.jl:38 [22] top-level scope @ none:6 15:53:29 | maxrss 1.6% | mem 1.6% | DONE test item "Foo4" 15:53:30 | maxrss 1.6% | mem 1.6% | START test item "testitem active" at macros.jl:138 15:53:30 | maxrss 1.6% | mem 1.6% | DONE test item "testitem active" <0.1 secs (85.5% compile), 3.29 K allocs (168.688 KB) 15:53:30 | maxrss 1.6% | mem 1.6% | START test item "run" at macros.jl:146 15:53:30 | maxrss 1.6% | mem 1.6% | DONE test item "run" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 15:53:30 | maxrss 1.6% | mem 1.6% | START test item "comparisons" at macros.jl:182 15:53:31 | maxrss 1.6% | mem 1.6% | DONE test item "comparisons" 0.1 secs (85.4% compile), 30.15 K allocs (1.785 MB) 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa bool" at macros.jl:306 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "test contains error" at macros.jl:314 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 1" at macros.jl:335 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 2" at macros.jl:345 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr loads module" at macros.jl:362 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 15:53:38 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 15:53:38 | maxrss 1.6% | mem 1.6% | START test item "default_imports" at macros.jl:424 15:53:38 | maxrss 1.6% | mem 1.6% | DONE test item "default_imports" <0.1 secs (57.8% compile), 1.96 K allocs (95.040 KB) 15:53:38 | maxrss 1.6% | mem 1.6% | START test item "no_default_imports" at macros.jl:432 15:53:38 | maxrss 1.6% | mem 1.6% | DONE test item "no_default_imports" 0.1 secs (96.5% compile), 298.11 K allocs (16.763 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/0nAwp` Updating `~/.julia/packages/ReTestItems/0nAwp/Project.toml` [1e6cf692] + TestEnv v1.102.2 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/0nAwp/Manifest.toml` [1e6cf692] + TestEnv v1.102.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:14 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 15:54:15 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.88 K allocs (101.304 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:15 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 15:54:15 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (99.056 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:15 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 15:54:15 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.344 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` 15:54:18 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at src/foo_test.jl:1 15:54:18 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" 0.7 secs (3.5% compile), 56.77 K allocs (6.734 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 15:54:19 | maxrss 1.9% | mem 1.9% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 15:54:19 | maxrss 1.9% | mem 1.9% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:54:19 | maxrss 1.9% | mem 1.9% | START (7/8) test item "bar" at src/bar_tests.jl:1 15:54:20 | maxrss 1.9% | mem 1.9% | DONE (7/8) test item "bar" 0.6 secs (97.5% compile), 330.53 K allocs (15.765 MB) 15:54:20 | maxrss 1.9% | mem 1.9% | START (8/8) test item "foo" at src/foo_test.jl:1 15:54:20 | maxrss 1.9% | mem 1.9% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.88 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.92 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:22 | maxrss 1.9% | mem 1.9% | START (1/1) test item "bar" at src/bar_tests.jl:1 15:54:22 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.97 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:25 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 15:54:25 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.16 seconds. [ Info: Scheduling 1 tests on pid 15 15:54:27 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 15:54:27 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.23 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 15 15:54:32 | maxrss 1.9% | mem 1.9% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 15:54:32 | maxrss 1.9% | mem 1.9% | DONE (1/5) test item "scope test - loops" <0.1 secs (75.1% compile), 4.13 K allocs (212.688 KB) 15:54:32 | maxrss 1.9% | mem 1.9% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 15:54:32 | maxrss 1.9% | mem 1.9% | DONE (2/5) test item "scope test - setups" <0.1 secs (79.0% compile), 4.37 K allocs (226.688 KB) 15:54:32 | maxrss 1.9% | mem 1.9% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 15:54:32 | maxrss 1.9% | mem 1.9% | DONE (3/5) test item "scope test - testsets" <0.1 secs (64.9% compile), 5.09 K allocs (250.720 KB) 15:54:32 | maxrss 1.9% | mem 1.9% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 15:54:32 | maxrss 1.9% | mem 1.9% | DONE (4/5) test item "scope test - imports" <0.1 secs (75.7% compile), 8.49 K allocs (412.288 KB) 15:54:32 | maxrss 1.9% | mem 1.9% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 15:54:32 | maxrss 1.9% | mem 1.9% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.71 K allocs (127.440 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl/Manifest.toml:0 Testing NoDeps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_P4ycpX/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [8dfed614] Test v1.11.0 Status `/tmp/jl_P4ycpX/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.12 seconds. [ Info: Scheduling 2 tests on pid 57 15:54:59 | maxrss 1.9% | mem 2.7% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 15:55:00 | maxrss 1.9% | mem 2.7% | DONE (1/2) test item "toplevel" 0.2 secs (94.8% compile), 29.55 K allocs (1.573 MB) 15:55:00 | maxrss 1.9% | mem 2.7% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 15:55:00 | maxrss 1.9% | mem 2.7% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.4% compile), 40.21 K allocs (2.291 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 57 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.3s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.1s Testing NoDeps tests passed Testing TestsInSrc ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_D3o5qA/Project.toml` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_D3o5qA/Manifest.toml` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [1e6cf692] TestEnv v1.102.2 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.17 seconds. [ Info: Scheduling 8 tests on pid 61 15:55:25 | maxrss 1.9% | mem 2.7% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 15:55:25 | maxrss 1.9% | mem 2.7% | DONE (1/8) test item "a1" 0.2 secs (94.5% compile), 30.13 K allocs (1.625 MB) 15:55:25 | maxrss 1.9% | mem 2.7% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (2/8) test item "a2" 0.2 secs (92.7% compile), 39.12 K allocs (2.238 MB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (7/8) test item "bar" at src/bar_tests.jl:1 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (7/8) test item "bar" 0.6 secs (97.6% compile), 332.86 K allocs (15.873 MB) 15:55:26 | maxrss 1.9% | mem 2.7% | START (8/8) test item "foo" at src/foo_test.jl:1 15:55:26 | maxrss 1.9% | mem 2.7% | DONE (8/8) test item "foo" <0.1 secs (73.1% compile), 3.70 K allocs (179.480 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.2s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.1s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.6s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed Testing TestProjectFile ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_W805nI/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_W805nI/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.5.0 [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [1e6cf692] TestEnv v1.102.2 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling TestProjectFile... 828.4 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.17 seconds. [ Info: Scheduling 1 tests on pid 65 15:55:52 | maxrss 1.9% | mem 2.7% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 15:55:54 | maxrss 1.9% | mem 2.8% | DONE (1/1) test item "TestProjectFile" 2.4 secs (38.8% compile, 10.8% recompile), 351.84 K allocs (21.449 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 65 Precompiling InlineStrings... 1234.4 ms ✓ InlineStrings 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 5.5s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.4s test-only dep on InlineStrings | 1 1 2.1s Testing TestProjectFile tests passed Testing TestEndExpr Status `/tmp/jl_0fYl74/Project.toml` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_0fYl74/Manifest.toml` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling ReTestItems... 3363.3 ms ✓ TestEnv 5736.5 ms ✓ ReTestItems 2 dependencies successfully precompiled in 9 seconds. 26 already precompiled. Precompiling TestEndExpr... 627.5 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.29 seconds. [ Info: Scheduling 2 tests on pid 77 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 93: [ Info: Starting test worker 1 on pid = 93, with 2 threads [ Info: Starting running test items Worker 93: 15:56:52 | maxrss 1.4% | mem 3.5% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 93: 15:56:53 | maxrss 1.4% | mem 3.5% | DONE (1/2) test item "correct usage" 0.3 secs (96.4% compile), 61.39 K allocs (3.212 MB) Worker 93: 15:56:54 | maxrss 1.4% | mem 3.5% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 93: 15:56:54 | maxrss 1.4% | mem 3.5% | DONE (2/2) test item "incorrect usage" <0.1 secs (69.6% compile), 2.82 K allocs (145.208 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=93). Worker 93: [93] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 29.9s Testing TestEndExpr tests passed Testing DontPass ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_sfh4Ca/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [37e2e46d] LinearAlgebra v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_sfh4Ca/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Precompiling DontPass... 705.7 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.37 seconds. [ Info: Scheduling 9 tests on pid 98 15:57:21 | maxrss 1.9% | mem 2.8% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 15:57:22 | maxrss 1.9% | mem 2.8% | DONE (1/9) test item "do_thing Pass" 0.7 secs (98.6% compile), 302.69 K allocs (14.295 MB) 15:57:23 | maxrss 1.9% | mem 2.8% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 15:57:24 | maxrss 1.9% | mem 2.8% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.1% compile), 115.28 K allocs (6.607 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 98 Error in testset "do_thing Fail" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.9759194933144015, 0.13819015362709086, 0.20336493236999453] == 1 15:57:24 | maxrss 1.9% | mem 2.8% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 15:57:34 | maxrss 1.9% | mem 3.0% | DONE (3/9) test item "do_thing Error" 9.3 secs (91.1% compile, 0.8% GC), 5.72 M allocs (337.078 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 98 Error in testset "do_thing Error" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 15:57:34 | maxrss 1.9% | mem 3.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 15:57:35 | maxrss 1.9% | mem 3.0% | DONE (4/9) test item "bad setup, good test" 1.0 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 98 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 98 Error in testset "bad setup, good test" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:381 [21] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] #runtests#50 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:276 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:273 [inlined] [27] #runtests#49 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:272 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 15:57:35 | maxrss 1.9% | mem 3.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 15:57:35 | maxrss 1.9% | mem 3.0% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 98 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 98 Error in testset "bad setup, bad test" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:381 [21] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] #runtests#50 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:276 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:273 [inlined] [27] #runtests#49 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:272 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 15:57:35 | maxrss 1.9% | mem 3.0% | START (6/9) test item "errors" at test/error_tests.jl:1 15:57:37 | maxrss 1.9% | mem 3.0% | DONE (6/9) test item "errors" 1.4 secs (50.0% compile, 2.3% GC), 159.50 K allocs (9.380 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 98 Error in testset "UndefVarError" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#250"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#250"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [23] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:381 [26] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [29] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [30] #runtests#50 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:276 [inlined] [31] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:273 [inlined] [32] #runtests#49 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:272 [inlined] [33] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [34] include(fname::String) @ Main ./sysimg.jl:38 [35] top-level scope @ none:6 15:57:37 | maxrss 1.9% | mem 3.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 15:57:37 | maxrss 1.9% | mem 3.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 98 Error in testset "errors at the top level" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [15] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:381 [18] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [22] #runtests#50 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:276 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:273 [inlined] [24] #runtests#49 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:272 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(fname::String) @ Main ./sysimg.jl:38 [27] top-level scope @ none:6 15:57:37 | maxrss 1.9% | mem 3.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 15:57:37 | maxrss 1.9% | mem 3.0% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 98 Error in testset "nonexistent test setup" on worker 98: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [14] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:381 [17] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [21] #runtests#50 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:276 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:273 [inlined] [23] #runtests#49 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:272 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(fname::String) @ Main ./sysimg.jl:38 [26] top-level scope @ none:6 15:57:37 | maxrss 1.9% | mem 3.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 15:57:37 | maxrss 1.9% | mem 3.0% | DONE (9/9) test item "failures" <0.1 secs (82.7% compile), 12.21 K allocs (600.432 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 98 Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.3734171947101901 < 0 Error in testset "failures" on worker 98: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 19.8s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.4s do_thing Error | 1 1 9.3s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 1.0s bad setup, bad test | 1 1 0.3s test/error_tests.jl | 1 6 7 errors | 4 4 1.7s UndefVarError | 2 2 0.8s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.4s nonexistent test setup | 1 1 0.2s test/failure_tests.jl | 3 3 failures | 3 3 0.1s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 15:57:40 | maxrss 2.0% | mem 2.0% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.62 K allocs (84.576 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.73 K allocs (128.016 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 15:57:40 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 15:57:40 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 15:57:40 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 15:57:40 | maxrss 2.0% | mem 2.0% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 15:57:41 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "TestProjectFile" 0.7 secs (72.0% compile, 34.8% recompile, 3.0% GC), 245.90 K allocs (14.165 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 15 15:57:44 | maxrss 2.0% | mem 2.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 15:57:44 | maxrss 2.0% | mem 2.0% | DONE (1/9) test item "do_thing Pass" <0.1 secs (71.3% compile), 13.23 K allocs (715.240 KB) 15:57:44 | maxrss 2.0% | mem 2.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 15:57:45 | maxrss 2.0% | mem 2.0% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.3% compile), 116.29 K allocs (6.679 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.13316506679689932, 0.6929497900286267, 0.550357306690298] == 1 15:57:45 | maxrss 2.0% | mem 2.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 15:57:47 | maxrss 2.0% | mem 2.0% | DONE (3/9) test item "do_thing Error" 1.7 secs (50.7% compile, 3.6% GC), 989.40 K allocs (65.053 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 15:57:47 | maxrss 2.0% | mem 2.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 15:57:47 | maxrss 2.0% | mem 2.0% | DONE (4/9) test item "bad setup, good test" 0.7 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:298 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [27] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [28] #106 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:225 [inlined] [29] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:194 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 15:57:47 | maxrss 2.0% | mem 2.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 15:57:48 | maxrss 2.0% | mem 2.0% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:298 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [27] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [28] #106 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:225 [inlined] [29] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:194 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 15:57:48 | maxrss 2.0% | mem 2.0% | START (6/9) test item "errors" at test/error_tests.jl:1 15:57:49 | maxrss 2.0% | mem 2.0% | DONE (6/9) test item "errors" 1.2 secs (17.9% compile), 46.88 K allocs (3.123 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#442"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#442"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [23] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [26] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [30] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:298 [31] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [32] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [33] #106 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:225 [inlined] [34] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [36] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [43] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [47] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:194 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [50] include @ ./sysimg.jl:38 [inlined] [51] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [52] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [55] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [56] include(fname::String) @ Main ./sysimg.jl:38 15:57:49 | maxrss 2.0% | mem 2.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 15:57:49 | maxrss 2.0% | mem 2.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [15] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [18] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:298 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [24] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [25] #106 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:225 [inlined] [26] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [28] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [33] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [35] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:194 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [42] include @ ./sysimg.jl:38 [inlined] [43] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [44] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [47] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [48] include(fname::String) @ Main ./sysimg.jl:38 [49] top-level scope @ none:6 15:57:49 | maxrss 2.0% | mem 2.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 15:57:50 | maxrss 2.0% | mem 2.0% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [14] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [17] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:298 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [24] #106 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:225 [inlined] [25] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:224 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:194 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 15:57:50 | maxrss 2.0% | mem 2.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 15:57:50 | maxrss 2.0% | mem 2.0% | DONE (9/9) test item "failures" <0.1 secs (83.2% compile), 12.31 K allocs (607.440 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.404735859157774 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:03:47 | maxrss 2.0% | mem 2.0% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 16:03:50 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "MonoRepo tests" 2.5 secs (<0.1% compile, 1.0% GC), 67.14 K allocs (7.886 MB) [ Tests Completed: 1/1 test items were run. Testing C ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_UpVafq/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [8dfed614] Test v1.11.0 Status `/tmp/jl_UpVafq/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.34.0 `~/.julia/packages/ReTestItems/0nAwp` [1e6cf692] TestEnv v1.102.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.11 seconds. [ Info: Scheduling 1 tests on pid 187 16:04:14 | maxrss 2.0% | mem 2.8% | START (1/1) test item "C_tests" at test/c_tests.jl:1 16:04:14 | maxrss 2.0% | mem 2.8% | DONE (1/1) test item "C_tests" 0.3 secs (94.8% compile), 42.85 K allocs (2.345 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 3.6s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.3s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/nGMfF/src/julia-1.11/activate_set.jl:76 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:16 | maxrss 2.0% | mem 2.0% | START (1/1) test item "C_tests" at test/c_tests.jl:1 16:04:16 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 2.28 K allocs (115.080 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:16 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 16:04:16 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:18 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 16:04:18 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:18 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 16:04:18 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:18 | maxrss 2.0% | mem 2.0% | START (1/2) test item "bar" at src/bar_tests.jl:1 16:04:18 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 16:04:18 | maxrss 2.0% | mem 2.0% | START (2/2) test item "foo" at src/foo_test.jl:1 16:04:18 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:20 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 16:04:20 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 16:04:20 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 16:04:20 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 16:04:21 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 16:04:21 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 16:04:21 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:152 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:23 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:23 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:23 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:23 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:23 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:23 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:25 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:25 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:25 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:25 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:27 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:27 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:27 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:27 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:27 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:27 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:27 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:27 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.24 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:29 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:29 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:29 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:29 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:29 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:29 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:29 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:29 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:31 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:31 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:32 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:32 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.01 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:34 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:34 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:34 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:34 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:34 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:34 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:34 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:34 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:35 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:35 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:35 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:35 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:35 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:35 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:41 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:41 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:41 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:04:41 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:41 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:41 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:41 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:04:42 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:42 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:42 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:42 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:42 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:42 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:42 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:42 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:04:51 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 16:04:51 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 16:04:51 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 16:04:51 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 16:04:51 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 16:04:51 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. 16:04:51 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 16:04:51 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 5.55 K allocs (239.544 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:597 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 191: [ Info: Starting test worker 1 on pid = 191, with 2 threads\n[ Info: Starting running test items\n Worker 191: 16:05:08 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 191: 16:05:11 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 2.2 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963\n [10] #91\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106\n [18] top-level scope\n @ none:1\n\n Worker 191: 16:05:12 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 191: 16:05:12 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963\n [10] #91\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=191).\n Worker 191: [191] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:597 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:585 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:603 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 191: [ Info: Starting test worker 1 on pid = 191, with 2 threads\n[ Info: Starting running test items\n Worker 191: 16:05:08 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 191: 16:05:11 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 2.2 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963\n [10] #91\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106\n [18] top-level scope\n @ none:1\n\n Worker 191: 16:05:12 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 191: 16:05:12 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963\n [10] #91\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [12] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=191).\n Worker 191: [191] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:603 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:585 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 206: [ Info: Starting test worker 1 on pid = 206, with 2 threads [ Info: Starting running test items Worker 206: 16:06:05 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 206: [206] signal 15: Terminated in expression starting at none:1 _ZN4llvm15ValueHandleBase12AddToUseListEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13LazyValueInfo10eraseBlockEPNS_10BasicBlockE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm17JumpThreadingPass7runImplERNS_8FunctionEPNS_17TargetLibraryInfoEPNS_19TargetTransformInfoEPNS_13LazyValueInfoEPNS_9AAResultsEPNS_14DomTreeUpdaterEbSt10unique_ptrINS_18BlockFrequencyInfoESt14default_deleteISE_EESD_INS_21BranchProbabilityInfoESF_ISI_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 206 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 206 ┌ Error: Worker(pid=206, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 211: [ Info: Starting test worker on pid = 211, with 2 threads Worker 211: 16:06:21 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 211: 16:06:23 | maxrss 2.1% | mem 2.8% | DONE (1/6) test item "Pass on second run" 0.2 secs (93.6% compile), 6.93 K allocs (342.968 KB) Worker 211: [211] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 211 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 211 ┌ Error: Worker(pid=211, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 216: [ Info: Starting test worker on pid = 216, with 2 threads Worker 216: 16:06:38 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 216: [216] signal 15: Terminated in expression starting at none:1 _ZNK4llvm13ConstantRange22unsignedSubMayOverflowERKS0_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0x77efe83f8ddf) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 216 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 216 ┌ Error: Worker(pid=216, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 221: [ Info: Starting test worker on pid = 221, with 2 threads Worker 221: 16:06:54 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 221 [221] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:25 malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) operator new at /workspace/srcdir/gcc-13.2.0/libstdc++-v3/libsupc++/new_op.cc:50 _ZN4llvm15callDefaultCtorIN12_GLOBAL__N_110ShrinkWrapELb1EEEPNS_4PassEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm16TargetPassConfig16addMachinePassesEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZL23addPassesToGenerateCodeRN4llvm17LLVMTargetMachineERNS_6legacy15PassManagerBaseEbRNS_28MachineModuleInfoWrapperPassE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm17LLVMTargetMachine17addPassesToEmitMCERNS_6legacy15PassManagerBaseERPNS_9MCContextERNS_17raw_pwrite_streamEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=221, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 226: [ Info: Starting test worker on pid = 226, with 2 threads Worker 226: 16:07:09 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 226 [226] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:25 _ZN4llvm13LazyCallGraph16buildGenericSCCsIRNS_14iterator_rangeISt16reverse_iteratorIPPNS0_4NodeEEEEZNS0_9buildSCCsERNS0_6RefSCCES8_EUlRS4_E_ZNS0_9buildSCCsESB_S8_EUlSC_E0_ZNS0_9buildSCCsESB_S8_EUlNS0_12EdgeSequence13call_iteratorEE1_ZNS0_9buildSCCsESB_S8_EUlS8_E2_EEvOT_OT0_OT1_OT2_OT3_.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0x1) _ZN4llvm13LazyCallGraph9buildSCCsERNS0_6RefSCCENS_14iterator_rangeISt16reverse_iteratorIPPNS0_4NodeEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0x1c683eed1c6893f) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 ┌ Error: Worker(pid=226, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 231: [ Info: Starting test worker on pid = 231, with 2 threads Worker 231: 16:07:25 | maxrss 2.1% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 231 [231] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x79e58b8d3f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 task_done_hook at ./task.jl:694 ┌ Error: Worker(pid=231, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 236: [ Info: Starting test worker on pid = 236, with 2 threads Worker 236: 16:07:41 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 236: 16:07:43 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.1 secs (93.6% compile), 6.84 K allocs (339.408 KB) Worker 236: [236] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 236 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 236 ┌ Error: Worker(pid=236, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 241: [ Info: Starting test worker on pid = 241, with 2 threads Worker 241: 16:07:57 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 241: 16:07:59 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.9% compile), 6.84 K allocs (339.408 KB) Worker 241: [241] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 241 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 241 ┌ Error: Worker(pid=241, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 246: [ Info: Starting test worker on pid = 246, with 2 threads Worker 246: 16:08:13 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 246: 16:08:15 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (94.0% compile), 6.84 K allocs (339.408 KB) Worker 246: [246] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 246 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 246 ┌ Error: Worker(pid=246, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 251: [ Info: Starting test worker on pid = 251, with 2 threads Worker 251: 16:08:29 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 251: 16:08:31 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.8% compile), 6.84 K allocs (339.408 KB) Worker 251: [251] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 251 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 251 ┌ Error: Worker(pid=251, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 256: [ Info: Starting test worker on pid = 256, with 2 threads Worker 256: 16:08:46 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 256: 16:08:47 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (94.1% compile), 6.84 K allocs (339.408 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 256 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 256 ┌ Error: Worker(pid=256, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 261: [ Info: Starting test worker on pid = 261, with 2 threads Worker 261: 16:09:02 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 261: [261] signal 15: Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 261 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 261 ┌ Error: Worker(pid=261, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 266: [ Info: Starting test worker on pid = 266, with 2 threads Worker 266: 16:09:18 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 266: [266] signal 15: Terminated in expression starting at none:1 _ZNK4llvm12SelectionDAG16computeKnownBitsENS_7SDValueERKNS_5APIntEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0xfffffffffffffff6) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 266 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 266 ┌ Error: Worker(pid=266, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 271: [ Info: Starting test worker on pid = 271, with 2 threads Worker 271: 16:09:34 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 271: 16:09:36 | maxrss 2.1% | mem 2.8% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (93.7% compile), 6.84 K allocs (339.408 KB) Worker 271: [271] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 271 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 271 ┌ Error: Worker(pid=271, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 276: [ Info: Starting test worker on pid = 276, with 2 threads Worker 276: 16:09:50 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 276 [276] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x73e16b19df14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=276, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 281: [ Info: Starting test worker on pid = 281, with 2 threads Worker 281: 16:10:06 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 281 [281] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x712af282df14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=281, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 286: [ Info: Starting test worker on pid = 286, with 2 threads Worker 286: 16:10:23 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 286 [286] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7a2b41df2f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=286, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 291: [ Info: Starting test worker on pid = 291, with 2 threads Worker 291: 16:10:38 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 291 [291] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x7102c8c4bf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=291, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 296: [ Info: Starting test worker on pid = 296, with 2 threads Worker 296: 16:10:55 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 296: 16:10:55 | maxrss 2.1% | mem 2.8% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (96.1% compile), 100.83 K allocs (5.355 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=296). Worker 296: [296] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:663 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:663 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:665 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:665 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:668 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:668 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:671 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:671 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:681 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:681 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:857 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:857 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 301: [ Info: Starting test worker 1 on pid = 301, with 2 threads [ Info: Starting running test items Worker 301: 16:11:12 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 301 [301] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7c1b86fb5f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=301, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 306: [ Info: Starting test worker on pid = 306, with 2 threads Worker 306: 16:11:27 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 306: 16:11:28 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (94.9% compile), 20.62 K allocs (1.093 MB) Worker 306: [306] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 306 ┌ Error: Worker(pid=306, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=306, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:752 | Worker 1 closed: Worker(pid=306, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:721 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:721 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:714 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:713 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:723 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:714 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:829 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:857 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:857 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 311: [ Info: Starting test worker 1 on pid = 311, with 2 threads [ Info: Starting running test items Worker 311: 16:11:43 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 311 [311] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7fc9f5f82f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=311, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 316: [ Info: Starting test worker on pid = 316, with 2 threads Worker 316: 16:11:58 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 316: 16:11:59 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (94.7% compile), 20.62 K allocs (1.093 MB) Worker 316: [316] signal 15: Terminated in expression starting at none:1 _jl_mutex_wait at /source/src/threading.c:878 _jl_mutex_lock at /source/src/threading.c:906 jl_mutex_lock at /source/src/julia_locks.h:65 [inlined] JL_UV_LOCK at /source/src/jl_uv.c:137 [inlined] ijl_iolock_begin at /source/src/jl_uv.c:147 iolock_begin at ./libuv.jl:48 [inlined] uv_write at ./stream.jl:1086 unsafe_write at ./stream.jl:1154 unsafe_write at ./io.jl:803 [inlined] unsafe_write at ./io.jl:801 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 316 ┌ Error: Worker(pid=316, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=316, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:752 | Worker 1 closed: Worker(pid=316, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:743 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:743 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:734 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:733 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:745 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 321: [ Info: Starting test worker 1 on pid = 321, with 2 threads [ Info: Starting running test items Worker 321: 16:12:14 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 321 [321] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x72ad8b777f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x72ad82b39f15) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 #99 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 unknown function (ip: 0x72ad82b3859e) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:348 unknown function (ip: 0x72ad82b17c8a) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=321, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=321, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 326: [ Info: Starting test worker 1 on pid = 326, with 2 threads [ Info: Starting running test items Worker 326: 16:12:31 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 326 [326] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7515540eaf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x75154b539ec5) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 #99 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 unknown function (ip: 0x75154b53854e) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:348 unknown function (ip: 0x75154b517c8a) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=326, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=326, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 331: [ Info: Starting test worker 1 on pid = 331, with 2 threads [ Info: Starting running test items Worker 331: 16:12:49 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 331 [331] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x798e0ee84f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x798e06339f15) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 #99 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 #redirect_stdio#837 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 unknown function (ip: 0x798e0633859e) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/workers.jl:348 unknown function (ip: 0x798e06317c8a) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1202 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=331, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=331, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 341: [ Info: Starting test worker 1 on pid = 341, with 3,2 threads [ Info: Starting running test items Worker 341: 16:13:24 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 341: 16:13:24 | maxrss 2.1% | mem 2.8% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (94.7% compile), 27.05 K allocs (1.413 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=341). Worker 341: [341] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:820 overwritten at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:854. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.06 seconds. [ Info: Scheduling 3 tests on pid 15 16:13:28 | maxrss 2.1% | mem 2.1% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.856 KB) 16:13:28 | maxrss 2.1% | mem 2.1% | START (2/3) test item "other A" at test/integrationtests.jl:846 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) 16:13:28 | maxrss 2.1% | mem 2.1% | START (3/3) test item "other B" at test/integrationtests.jl:846 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 16:13:28 | maxrss 2.1% | mem 2.1% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.856 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:13:28 | maxrss 2.1% | mem 2.1% | START (1/2) test item "other A" at test/integrationtests.jl:846 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) 16:13:28 | maxrss 2.1% | mem 2.1% | START (2/2) test item "other B" at test/integrationtests.jl:846 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 16:13:28 | maxrss 2.1% | mem 2.1% | START (1/1) test item "other B" at test/integrationtests.jl:846 16:13:28 | maxrss 2.1% | mem 2.1% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.62 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:13:30 | maxrss 2.1% | mem 2.1% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 16:13:30 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.752 KB) 16:13:30 | maxrss 2.1% | mem 2.1% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 16:13:30 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.752 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 349: [ Info: Starting test worker 1 on pid = 349, with 2 threads [ Info: Starting running test items Worker 349: 16:13:43 | maxrss 2.1% | mem 2.8% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 349: 16:13:44 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "same name" 0.2 secs (94.3% compile), 20.62 K allocs (1.093 MB) Worker 349: 16:13:45 | maxrss 2.1% | mem 2.8% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 349: 16:13:45 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.880 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=349). Worker 349: [349] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 354: [ Info: Starting test worker 1 on pid = 354, with 2 threads [ Info: Starting running test items Worker 354: [354] signal 15: Terminated in expression starting at none:1 _ZN4llvm12SelectionDAG17DAGUpdateListener11NodeUpdatedEPNS_6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: 0x706c1f9fb40f) unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 354 ┌ Error: Worker(pid=354, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 Worker 359: [ Info: Starting test worker on pid = 359, with 2 threads Worker 359: [359] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 359 ┌ Error: Worker(pid=359, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714 [ Info: All tests on worker 1 completed. Closing Worker(pid=359, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:20:12 | maxrss 2.1% | mem 2.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) 16:20:12 | maxrss 2.1% | mem 2.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) 16:20:12 | maxrss 2.1% | mem 2.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 16:20:12 | maxrss 2.1% | mem 2.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 15 Error in testset "happy 1" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 16:20:12 | maxrss 2.1% | mem 2.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 15 Error in testset "happy 2" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 16:20:12 | maxrss 2.1% | mem 2.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 16:20:12 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 15 Error in testset "happy 3" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 486: [ Info: Starting test worker 1 on pid = 486, with 2 threads [ Info: Starting running test items Worker 486: 16:20:27 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 486: 16:20:27 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.3% compile), 21.24 K allocs (1.109 MB) Worker 486: 16:20:28 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 486: 16:20:28 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.53 K allocs (118.016 KB) Worker 486: 16:20:29 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 486: 16:20:29 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.016 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=486). Worker 486: [486] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 491: [ Info: Starting test worker 1 on pid = 491, with 2 threads [ Info: Starting running test items Worker 491: 16:20:44 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 491: 16:20:45 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.3% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 491 Error in testset "happy 1" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 491: 16:20:45 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 491: 16:20:45 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.808 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 491 Error in testset "happy 2" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 491: 16:20:45 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 491: 16:20:45 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.776 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 491 Error in testset "happy 3" on worker 491: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=491). Worker 491: [491] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 496: [ Info: Starting test worker 1 on pid = 496, with 2 threads Worker 498: [ Info: Starting test worker 2 on pid = 498, with 2 threads [ Info: Starting running test items Worker 498: 16:21:15 | maxrss 2.1% | mem 3.5% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 496: 16:21:15 | maxrss 2.1% | mem 3.5% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 496: 16:21:16 | maxrss 2.1% | mem 3.5% | DONE (1/3) test item "happy 1" 0.4 secs (93.7% compile), 21.24 K allocs (1.109 MB) Worker 498: 16:21:16 | maxrss 2.1% | mem 3.5% | DONE (2/3) test item "happy 2" 0.4 secs (93.8% compile), 21.24 K allocs (1.109 MB) Worker 496: 16:21:17 | maxrss 2.1% | mem 3.5% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 496: 16:21:17 | maxrss 2.1% | mem 3.5% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.016 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=496). Worker 496: [496] signal 15: Terminated [ Info: All tests on worker 2 completed. Closing Worker(pid=498). Worker 498: [498] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 508: [ Info: Starting test worker 2 on pid = 508, with 2 threads Worker 506: [ Info: Starting test worker 1 on pid = 506, with 2 threads [ Info: Starting running test items Worker 508: 16:21:47 | maxrss 2.1% | mem 3.4% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 506: 16:21:47 | maxrss 2.1% | mem 3.4% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 508: 16:21:49 | maxrss 2.1% | mem 3.4% | DONE (2/3) test item "happy 2" 0.4 secs (94.2% compile), 20.85 K allocs (1.095 MB) Worker 506: 16:21:49 | maxrss 2.1% | mem 3.4% | DONE (1/3) test item "happy 1" 0.4 secs (94.4% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 506 Error in testset "happy 1" on worker 506: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 506: 16:21:50 | maxrss 2.1% | mem 3.4% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 506: 16:21:50 | maxrss 2.1% | mem 3.4% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.776 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 506 Error in testset "happy 3" on worker 506: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 508 Error in testset "happy 2" on worker 508: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=506). Worker 506: [506] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x737b522c2f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Info: All tests on worker 2 completed. Closing Worker(pid=508). Worker 508: [508] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 516: [ Info: Starting test worker 1 on pid = 516, with 2 threads [ Info: Starting running test items Worker 516: 16:22:06 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 516: 16:22:06 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (94.5% compile), 21.33 K allocs (1.121 MB) Worker 516: 16:22:07 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 516: 16:22:07 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.05 K allocs (100.432 KB) Worker 516: 16:22:07 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 516: 16:22:07 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.05 K allocs (100.432 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=516). Worker 516: [516] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1088 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 15.9s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1088 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 521: [ Info: Starting test worker 1 on pid = 521, with 2 threads [ Info: Starting running test items Worker 521: 16:22:22 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 521: 16:22:24 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.3 secs (95.5% compile), 58.57 K allocs (3.270 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1099 Expression: false Worker 521: 16:22:25 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 521: 16:22:25 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.02 K allocs (138.672 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1099 Expression: false Worker 521: 16:22:25 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 521: 16:22:25 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.02 K allocs (138.672 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 521 Error in testset "post-testitem" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1099 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=521). Worker 521: [521] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7e63bd9e6f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1110 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.3s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1110 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1117 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.3s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.3s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1117 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 Activating project at `~/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl` [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 526: [ Info: Starting test worker 1 on pid = 526, with 2 threads [ Info: Starting running test items Worker 526: 16:22:40 | maxrss 2.1% | mem 2.8% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 526: 16:22:41 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "correct usage" 0.3 secs (96.2% compile), 61.46 K allocs (3.217 MB) Worker 526: 16:22:42 | maxrss 2.1% | mem 2.8% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 526: 16:22:42 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "incorrect usage" <0.1 secs (70.5% compile), 2.89 K allocs (149.784 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=526). Worker 526: [526] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 531: [ Info: Starting test worker 1 on pid = 531, with 2 threads [ Info: Starting running test items Worker 531: 16:22:56 | maxrss 2.1% | mem 2.8% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 531: 16:22:57 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "correct usage" 0.6 secs (97.1% compile), 212.34 K allocs (11.377 MB) Worker 531: 16:22:58 | maxrss 2.1% | mem 2.8% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 531: 16:22:59 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "incorrect usage" <0.1 secs (51.8% compile), 4.66 K allocs (222.416 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 531 Error in testset "no pins left at end of test" on worker 531: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1143 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=531). Worker 531: [531] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 15 16:23:01 | maxrss 2.1% | mem 2.1% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 16:23:01 | maxrss 2.1% | mem 2.1% | DONE (1/9) test item "do_thing Pass" 0.2 secs (95.7% compile, 70.7% recompile), 64.08 K allocs (3.586 MB) 16:23:01 | maxrss 2.1% | mem 2.1% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 16:23:01 | maxrss 2.1% | mem 2.1% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.50 K allocs (121.808 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 [ Info: RUNNING Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.13316506679689932, 0.6929497900286267, 0.550357306690298] == 1 16:23:01 | maxrss 2.1% | mem 2.1% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 16:23:02 | maxrss 2.1% | mem 2.1% | DONE (3/9) test item "do_thing Error" 0.7 secs (<0.1% compile), 259.30 K allocs (23.838 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 [ Info: RUNNING Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/src/do_thing_tests.jl:8 16:23:02 | maxrss 2.1% | mem 2.1% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 16:23:02 | maxrss 2.1% | mem 2.1% | DONE (4/9) test item "bad setup, good test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [26] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [27] #208 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1165 [inlined] [28] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1164 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1159 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1156 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 16:23:02 | maxrss 2.1% | mem 2.1% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 16:23:03 | maxrss 2.1% | mem 2.1% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [10] #91 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1001 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [12] redirect_stdio @ ./stream.jl:1411 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1000 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:975 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1106 [18] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [26] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [27] #208 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1165 [inlined] [28] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1164 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1159 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1156 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 16:23:03 | maxrss 2.1% | mem 2.1% | START (6/9) test item "errors" at test/error_tests.jl:1 16:23:04 | maxrss 2.1% | mem 2.1% | DONE (6/9) test item "errors" 1.0 secs (<0.1% compile), 25.29 K allocs (1.882 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#862"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#862"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [15] redirect_stdio @ ./stream.jl:1411 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [23] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [26] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [30] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [31] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [32] #208 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1165 [inlined] [33] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [35] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [42] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1164 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1159 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1156 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [48] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [49] include @ ./sysimg.jl:38 [inlined] [50] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [51] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [52] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [54] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [55] include(fname::String) @ Main ./sysimg.jl:38 16:23:04 | maxrss 2.1% | mem 2.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 16:23:04 | maxrss 2.1% | mem 2.1% | DONE (7/9) test item "errors at the top level" 0.3 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 [ Info: RUNNING Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [15] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [18] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [24] #208 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1165 [inlined] [25] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1164 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1159 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1156 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 16:23:04 | maxrss 2.1% | mem 2.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 16:23:04 | maxrss 2.1% | mem 2.1% | DONE (8/9) test item "nonexistent test setup" 0.3 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:963 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1140 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [6] redirect_stdio @ ./stream.jl:1411 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1137 [14] runtestitem @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:1059 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:394 [17] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:524 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:635 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:347 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [22] runtests @ ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:268 [inlined] [23] #208 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1165 [inlined] [24] #73 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [26] #72 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #71 @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [31] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:31 [33] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1164 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1159 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1156 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [40] include @ ./sysimg.jl:38 [inlined] [41] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:21 [42] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [43] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:17 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [45] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/runtests.jl:15 [46] include(fname::String) @ Main ./sysimg.jl:38 [47] top-level scope @ none:6 16:23:04 | maxrss 2.1% | mem 2.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 16:23:04 | maxrss 2.1% | mem 2.1% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.57 K allocs (169.992 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.404735859157774 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 3.3s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.2s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.7s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.4s bad setup, bad test | 1 1 0.4s test/error_tests.jl | 1 6 7 errors | 4 4 1.0s UndefVarError | 2 2 0.6s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.3s nonexistent test setup | 1 1 0.3s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1184. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1184 overwritten at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1215. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 581: [ Info: Starting test worker 1 on pid = 581, with 2 threads [ Info: Starting running test items Worker 581: 16:25:42 | maxrss 2.3% | mem 2.9% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 581: 16:25:42 | maxrss 2.3% | mem 2.9% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (94.9% compile), 20.62 K allocs (1.093 MB) Worker 581: 16:25:43 | maxrss 2.3% | mem 2.9% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 581: 16:25:44 | maxrss 2.3% | mem 2.9% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.97 K allocs (98.080 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 581 Error in testset "skip false, 1 pass, 1 fail" on worker 581: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_skip_tests.jl:8 Expression: false Worker 581: 16:25:44 | maxrss 2.3% | mem 2.9% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 581: 16:25:44 | maxrss 2.3% | mem 2.9% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 581: 16:25:44 | maxrss 2.3% | mem 2.9% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.97 K allocs (97.992 KB) Worker 581: 16:25:45 | maxrss 2.3% | mem 2.9% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 581: 16:25:46 | maxrss 2.3% | mem 2.9% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=581). Worker 581: [581] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1231 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 21.3s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1231 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1225 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_parse_error_test.jl 16:25:56 | maxrss 2.3% | mem 2.7% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/testfiles/_direct_testitem.jl:6 Test Summary: | Fail Total Time should fail | 1 1 4.8s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1300 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1298 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1334 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 595: [ Info: Starting test worker 1 on pid = 595, with 2 threads\n Worker 598: [ Info: Starting test worker 3 on pid = 598, with 2 threads\n Worker 597: [ Info: Starting test worker 2 on pid = 597, with 2 threads\n[ Info: Starting running test items\n Worker 595: [595] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm17ScheduleDAGInstrs19addSchedBarrierDepsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm17ScheduleDAGInstrs15buildSchedGraphEPNS_9AAResultsEPNS_18RegPressureTrackerEPNS_13PressureDiffsEPNS_13LiveIntervalsEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 598: [598] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x74813fa13f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 597: [597] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x722de0017f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 598\n┌ Error: Worker(pid=598, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\n\nNo Captured LogsNo Captured Logs for test item \"bad\" at for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:4test/testfiles/_failfast_failure_tests.jl:1 on worker 597\n┌ Error: Worker(pid=597, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n on worker 595[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\n┌ Error: Worker(pid=595, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 610: [ Info: Starting test worker on pid = 610, with 2 threads\n Worker 614: [ Info: Starting test worker on pid = 614, with 2 threads\n Worker 612: [ Info: Starting test worker on pid = 612, with 2 threads\n Worker 610: [610] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 614: [614] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7cca9887bf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 610\n┌ Error: Worker(pid=610, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=610, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 614\n┌ Error: Worker(pid=614, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n[ Info: All tests on worker 1 completed. Closing Worker(pid=614, terminated=true, termsignal=9).\n Worker 612: [612] signal 15: Terminated\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 612\n┌ Error: Worker(pid=612, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/0nAwp/src/ReTestItems.jl:714\n[ Info: All tests on worker 2 completed. Closing Worker(pid=612, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1334 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1300 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1298 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1300 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1298 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1300 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1298 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1325 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1312 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1300 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:1298 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/0nAwp/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 16:33:59 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 16:33:59 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 15 Error in testset "test set" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 16:34:02 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 16:34:02 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 15 Error in testset "Failure at toplevel" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 16:34:02 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 16:34:02 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 15 Error in testset "Bar" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/0nAwp/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 task_done_hook at ./task.jl:694 jfptr_task_done_hook_66679.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] jl_finish_task at /source/src/task.c:319 start_task at /source/src/task.c:1213 unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 _ZNK4llvm4Type19getScalarSizeInBitsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) unknown function (ip: (nil)) Allocations: 10316595 (Pool: 10316272; Big: 323); GC: 11 Testing failed after 2637.92s ERROR: LoadError: Package ReTestItems errored during testing (received signal: TERM) Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2128 [3] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:2011 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:481 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval terminated after 2737.7s: test duration exceeded the time limit