Package evaluation to test ReTestItems on Julia 1.11.8 (29b3528cce*) started at 2026-01-20T01:26:33.887 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.11` Set-up completed after 8.86s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.11/Project.toml` [817f1d60] + ReTestItems v1.35.0 Updating `~/.julia/environments/v1.11/Manifest.toml` [817f1d60] + ReTestItems v1.35.0 [1e6cf692] + TestEnv v1.103.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 1.27s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling project... 1293.7 ms ✓ XMLDict 1 dependency successfully precompiled in 1 seconds. 39 already precompiled. Precompilation completed after 14.4s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_xx8dSx/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v1.0.0 [817f1d60] ReTestItems v1.35.0 [1e6cf692] TestEnv v1.103.2 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_xx8dSx/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.3 [b5f81e59] IOCapture v1.0.0 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.1 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.5.1 [817f1d60] ReTestItems v1.35.0 [1e6cf692] TestEnv v1.103.2 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 [02c8fc9c] XML2_jll v2.15.1+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Worker 23: [23] signal 15: Terminated Worker 27: [27] signal 15: Terminated Worker 35: [35] signal 15: Terminated ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:152 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:152 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:156 01:28:32 | maxrss 1.3% | mem 1.4% | SKIP (0/1) test item "skip" at internals.jl:296 01:28:37 | maxrss 1.4% | mem 1.4% | START test item "TI1" at macros.jl:32 01:28:37 | maxrss 1.4% | mem 1.4% | DONE test item "TI1" 0.1 secs (96.1% compile), 70.68 K allocs (3.982 MB) 01:28:37 | maxrss 1.4% | mem 1.4% | START test item "TI2" at macros.jl:43 01:28:37 | maxrss 1.4% | mem 1.4% | DONE test item "TI2" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 01:28:37 | maxrss 1.4% | mem 1.4% | START test item "TI" at macros.jl:53 01:28:37 | maxrss 1.4% | mem 1.4% | DONE test item "TI" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 01:28:38 | maxrss 1.4% | mem 1.4% | START test item "macro-import" at macros.jl:64 01:28:40 | maxrss 1.4% | mem 1.4% | DONE test item "macro-import" 2.4 secs (99.4% compile), 822.51 K allocs (44.846 MB) 01:28:40 | maxrss 1.4% | mem 1.4% | START test item "Foo" at macros.jl:95 01:28:41 | maxrss 1.4% | mem 1.4% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.79 K allocs (132.776 KB) 01:28:41 | maxrss 1.4% | mem 1.4% | START test item "Foo3" at macros.jl:110 01:28:41 | maxrss 1.4% | mem 1.4% | DONE test item "Foo3" <0.1 secs (55.9% compile), 2.94 K allocs (144.952 KB) 01:28:41 | maxrss 1.4% | mem 1.4% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [5] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:109 [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [7] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [8] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [9] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1053 [10] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/macros.jl:123 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/macros.jl:118 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/macros.jl:23 [15] include @ ./sysimg.jl:38 [inlined] [16] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:20 [17] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [18] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [20] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [21] include(fname::String) @ Main ./sysimg.jl:38 [22] top-level scope @ none:6 01:28:45 | maxrss 1.6% | mem 1.6% | DONE test item "Foo4" 01:28:45 | maxrss 1.6% | mem 1.6% | START test item "testitem active" at macros.jl:138 01:28:45 | maxrss 1.6% | mem 1.6% | DONE test item "testitem active" <0.1 secs (84.8% compile), 3.29 K allocs (168.688 KB) 01:28:45 | maxrss 1.6% | mem 1.6% | START test item "run" at macros.jl:146 01:28:45 | maxrss 1.6% | mem 1.6% | DONE test item "run" <0.1 secs (<0.1% compile), 1.52 K allocs (78.288 KB) 01:28:46 | maxrss 1.6% | mem 1.6% | START test item "comparisons" at macros.jl:182 01:28:46 | maxrss 1.6% | mem 1.6% | DONE test item "comparisons" 0.2 secs (85.1% compile), 30.15 K allocs (1.786 MB) 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa bool" at macros.jl:306 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "test contains error" at macros.jl:314 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 1" at macros.jl:335 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 2" at macros.jl:345 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr loads module" at macros.jl:362 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 01:28:54 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 01:28:54 | maxrss 1.6% | mem 1.6% | START test item "default_imports" at macros.jl:424 01:28:54 | maxrss 1.6% | mem 1.6% | DONE test item "default_imports" <0.1 secs (58.2% compile), 1.96 K allocs (95.040 KB) 01:28:54 | maxrss 1.6% | mem 1.6% | START test item "no_default_imports" at macros.jl:432 01:28:54 | maxrss 1.6% | mem 1.6% | DONE test item "no_default_imports" 0.2 secs (97.5% compile), 298.11 K allocs (16.746 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/5fo5Q` Updating `~/.julia/packages/ReTestItems/5fo5Q/Project.toml` [1e6cf692] + TestEnv v1.103.2 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/5fo5Q/Manifest.toml` [1e6cf692] + TestEnv v1.103.2 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [deac9b47] + LibCURL_jll v8.6.0+0 [e37daf67] + LibGit2_jll v1.7.2+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.6+0 [14a3606d] + MozillaCACerts_jll v2023.12.12 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.59.0+0 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:31 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 01:29:31 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.88 K allocs (101.304 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:31 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 01:29:31 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (99.056 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:31 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 01:29:31 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.80 K allocs (95.344 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` 01:29:34 | maxrss 1.9% | mem 1.9% | START (1/1) test item "foo" at src/foo_test.jl:1 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "foo" 0.7 secs (3.2% compile, 1.8% GC), 64.68 K allocs (7.203 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 01:29:35 | maxrss 1.9% | mem 1.9% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 01:29:35 | maxrss 1.9% | mem 1.9% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:29:35 | maxrss 1.9% | mem 1.9% | START (7/8) test item "bar" at src/bar_tests.jl:1 01:29:36 | maxrss 1.9% | mem 1.9% | DONE (7/8) test item "bar" 0.6 secs (97.5% compile), 330.53 K allocs (15.764 MB) 01:29:36 | maxrss 1.9% | mem 1.9% | START (8/8) test item "foo" at src/foo_test.jl:1 01:29:36 | maxrss 1.9% | mem 1.9% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.98 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.96 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:39 | maxrss 1.9% | mem 1.9% | START (1/1) test item "bar" at src/bar_tests.jl:1 01:29:39 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.96 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:41 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 01:29:41 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scheduling 1 tests on pid 15 01:29:43 | maxrss 1.9% | mem 1.9% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 01:29:43 | maxrss 1.9% | mem 1.9% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.31 seconds. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 15 01:29:48 | maxrss 1.9% | mem 1.9% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 01:29:48 | maxrss 1.9% | mem 1.9% | DONE (1/5) test item "scope test - loops" <0.1 secs (74.9% compile), 4.13 K allocs (212.720 KB) 01:29:48 | maxrss 1.9% | mem 1.9% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 01:29:48 | maxrss 1.9% | mem 1.9% | DONE (2/5) test item "scope test - setups" <0.1 secs (78.6% compile), 4.37 K allocs (226.688 KB) 01:29:48 | maxrss 1.9% | mem 1.9% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 01:29:48 | maxrss 1.9% | mem 1.9% | DONE (3/5) test item "scope test - testsets" <0.1 secs (65.5% compile), 5.09 K allocs (250.752 KB) 01:29:48 | maxrss 1.9% | mem 1.9% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 01:29:48 | maxrss 1.9% | mem 1.9% | DONE (4/5) test item "scope test - imports" <0.1 secs (74.7% compile), 8.49 K allocs (412.320 KB) 01:29:48 | maxrss 1.9% | mem 1.9% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 01:29:48 | maxrss 1.9% | mem 1.9% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.71 K allocs (127.440 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl/Manifest.toml:0 Testing NoDeps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_ZET4hR/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [8dfed614] Test v1.11.0 Status `/tmp/jl_ZET4hR/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.1 seconds. [ Info: Scheduling 2 tests on pid 57 01:30:16 | maxrss 1.9% | mem 2.7% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 01:30:16 | maxrss 1.9% | mem 2.7% | DONE (1/2) test item "toplevel" 0.2 secs (94.5% compile), 31.50 K allocs (1.684 MB) 01:30:16 | maxrss 1.9% | mem 2.7% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 01:30:16 | maxrss 1.9% | mem 2.7% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.2% compile), 40.21 K allocs (2.291 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 57 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.4s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.1s Testing NoDeps tests passed Testing TestsInSrc ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_CD6P80/Project.toml` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_CD6P80/Manifest.toml` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [1e6cf692] TestEnv v1.103.2 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.1 seconds. [ Info: Scheduling 8 tests on pid 61 01:30:40 | maxrss 1.9% | mem 2.7% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (1/8) test item "a1" 0.2 secs (94.7% compile), 32.08 K allocs (1.736 MB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (2/8) test item "a2" 0.2 secs (90.6% compile), 39.12 K allocs (2.238 MB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 01:30:41 | maxrss 1.9% | mem 2.7% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.55 K allocs (80.000 KB) 01:30:41 | maxrss 1.9% | mem 2.7% | START (7/8) test item "bar" at src/bar_tests.jl:1 01:30:42 | maxrss 1.9% | mem 2.7% | DONE (7/8) test item "bar" 0.6 secs (97.2% compile), 332.86 K allocs (15.873 MB) 01:30:42 | maxrss 1.9% | mem 2.7% | START (8/8) test item "foo" at src/foo_test.jl:1 01:30:42 | maxrss 1.9% | mem 2.7% | DONE (8/8) test item "foo" <0.1 secs (71.9% compile), 3.70 K allocs (179.480 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.0s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.1s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.6s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed Testing TestProjectFile ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_d6qEFH/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_d6qEFH/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.5.1 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [1e6cf692] TestEnv v1.103.2 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling TestProjectFile... 786.4 ms ✓ TestProjectFile 1 dependency successfully precompiled in 1 seconds. 1 already precompiled. [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.04 seconds. [ Info: Scheduling 1 tests on pid 65 01:31:07 | maxrss 1.9% | mem 2.7% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 01:31:10 | maxrss 1.9% | mem 2.8% | DONE (1/1) test item "TestProjectFile" 2.4 secs (38.8% compile, 10.2% recompile), 354.59 K allocs (21.716 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 65 Precompiling InlineStrings... 1210.4 ms ✓ InlineStrings 1 dependency successfully precompiled in 1 seconds. 8 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 5.4s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.4s test-only dep on InlineStrings | 1 1 2.0s Testing TestProjectFile tests passed Testing TestEndExpr Status `/tmp/jl_sb5yvO/Project.toml` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_sb5yvO/Manifest.toml` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling ReTestItems... 3303.8 ms ✓ TestEnv 5684.8 ms ✓ ReTestItems 2 dependencies successfully precompiled in 9 seconds. 26 already precompiled. Precompiling TestEndExpr... 607.5 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.31 seconds. [ Info: Scheduling 2 tests on pid 77 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 93: [ Info: Starting test worker 1 on pid = 93, with 2 threads [ Info: Starting running test items Worker 93: 01:32:09 | maxrss 1.4% | mem 3.5% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 93: 01:32:10 | maxrss 1.4% | mem 3.5% | DONE (1/2) test item "correct usage" 0.3 secs (96.4% compile), 61.46 K allocs (3.217 MB) Worker 93: 01:32:11 | maxrss 1.4% | mem 3.5% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 93: 01:32:11 | maxrss 1.4% | mem 3.5% | DONE (2/2) test item "incorrect usage" <0.1 secs (69.5% compile), 2.89 K allocs (149.752 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=93). Worker 93: [93] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 29.5s Testing TestEndExpr tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 Testing TestOnlyDeps Status `/tmp/jl_la6gRa/Project.toml` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [76c907bd] TestOnlyDeps v0.1.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 Status `/tmp/jl_la6gRa/Manifest.toml` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` ⌃ [1e6cf692] TestEnv v1.102.2 [76c907bd] TestOnlyDeps v0.1.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling ReTestItems... 3214.3 ms ✓ TestEnv 5834.3 ms ✓ ReTestItems 2 dependencies successfully precompiled in 9 seconds. 26 already precompiled. Precompiling TestOnlyDeps... 539.2 ms ✓ TestOnlyDeps 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `TestOnlyDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl [ Info: Finished scanning for test items in 5.04 seconds. [ Info: Scheduling 2 tests on pid 98 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 114: [ Info: Starting test worker 1 on pid = 114, with 2 threads [ Info: Starting running test items Worker 114: 01:33:10 | maxrss 1.4% | mem 3.5% | START (1/2) test item "use a test-only dep" at test/deps_tests.jl:1 Worker 114: 01:33:11 | maxrss 1.4% | mem 3.5% | DONE (1/2) test item "use a test-only dep" 0.2 secs (93.5% compile), 21.55 K allocs (1.173 MB) Worker 114: 01:33:12 | maxrss 1.4% | mem 3.5% | START (2/2) test item "deps as expected" at test/deps_tests.jl:6 Worker 114: 01:33:12 | maxrss 1.4% | mem 3.5% | DONE (2/2) test item "deps as expected" <0.1 secs (81.2% compile), 10.24 K allocs (550.272 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=114). Worker 114: [114] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestOnlyDeps | 2 2 29.0s Testing TestOnlyDeps tests passed Testing DontPass ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_NwOja0/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [37e2e46d] LinearAlgebra v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_NwOja0/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [4536629a] OpenBLAS_jll v0.3.27+1 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... Precompiling DontPass... 675.3 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 28 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.03 seconds. [ Info: Scheduling 9 tests on pid 119 01:33:39 | maxrss 1.9% | mem 2.7% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 01:33:40 | maxrss 1.9% | mem 2.7% | DONE (1/9) test item "do_thing Pass" 0.7 secs (98.7% compile), 304.65 K allocs (14.406 MB) 01:33:40 | maxrss 1.9% | mem 2.7% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 01:33:41 | maxrss 1.9% | mem 2.7% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.1% compile), 115.28 K allocs (6.605 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 119 Error in testset "do_thing Fail" on worker 119: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.6437116915706947, 0.49037774002829104, 0.831538884364746] == 1 01:33:42 | maxrss 1.9% | mem 2.7% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 01:33:51 | maxrss 1.9% | mem 3.0% | DONE (3/9) test item "do_thing Error" 9.3 secs (90.4% compile, 1.7% GC), 5.72 M allocs (337.069 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 119 Error in testset "do_thing Error" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 01:33:51 | maxrss 1.9% | mem 3.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 01:33:52 | maxrss 1.9% | mem 3.0% | DONE (4/9) test item "bad setup, good test" 1.0 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 119 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 119 Error in testset "bad setup, good test" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:381 [21] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] #runtests#50 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:276 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:273 [inlined] [27] #runtests#49 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:272 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 01:33:52 | maxrss 1.9% | mem 3.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 01:33:52 | maxrss 1.9% | mem 3.0% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 119 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 119 Error in testset "bad setup, bad test" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:381 [21] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] #runtests#50 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:276 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:273 [inlined] [27] #runtests#49 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:272 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Main ./sysimg.jl:38 [30] top-level scope @ none:6 01:33:52 | maxrss 1.9% | mem 3.0% | START (6/9) test item "errors" at test/error_tests.jl:1 01:33:54 | maxrss 1.9% | mem 3.0% | DONE (6/9) test item "errors" 1.4 secs (49.2% compile), 159.50 K allocs (9.380 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 119 Error in testset "UndefVarError" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#250"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#250"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [15] redirect_stdio @ ./stream.jl:1416 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [23] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:381 [26] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [29] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [30] #runtests#50 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:276 [inlined] [31] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:273 [inlined] [32] #runtests#49 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:272 [inlined] [33] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [34] include(fname::String) @ Main ./sysimg.jl:38 [35] top-level scope @ none:6 01:33:54 | maxrss 1.9% | mem 3.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 01:33:55 | maxrss 1.9% | mem 3.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 119 Error in testset "errors at the top level" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [7] redirect_stdio @ ./stream.jl:1416 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [15] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:381 [18] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [22] #runtests#50 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:276 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:273 [inlined] [24] #runtests#49 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:272 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(fname::String) @ Main ./sysimg.jl:38 [27] top-level scope @ none:6 01:33:55 | maxrss 1.9% | mem 3.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 01:33:55 | maxrss 1.9% | mem 3.0% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 119 Error in testset "nonexistent test setup" on worker 119: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [6] redirect_stdio @ ./stream.jl:1416 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [14] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:381 [17] with_logstate(f::ReTestItems.var"#55#56"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [21] #runtests#50 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:276 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:273 [inlined] [23] #runtests#49 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:272 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(fname::String) @ Main ./sysimg.jl:38 [26] top-level scope @ none:6 01:33:55 | maxrss 1.9% | mem 3.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 01:33:55 | maxrss 1.9% | mem 3.0% | DONE (9/9) test item "failures" <0.1 secs (82.7% compile), 12.21 K allocs (600.432 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 119 Error in testset "failures" on worker 119: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 119: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.15881783547211462 < 0 Error in testset "failures" on worker 119: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 19.6s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.4s do_thing Error | 1 1 9.3s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 1.0s bad setup, bad test | 1 1 0.3s test/error_tests.jl | 1 6 7 errors | 4 4 1.7s UndefVarError | 2 2 0.8s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.4s nonexistent test setup | 1 1 0.2s test/failure_tests.jl | 3 3 failures | 3 3 0.1s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 01:33:57 | maxrss 2.0% | mem 2.0% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.62 K allocs (84.576 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.73 K allocs (128.016 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 01:33:57 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 01:33:57 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 01:33:57 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.11/activate_set.jl:78 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:33:58 | maxrss 2.0% | mem 2.0% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 01:33:58 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "TestProjectFile" 0.7 secs (72.5% compile, 35.2% recompile, 1.8% GC), 245.51 K allocs (14.193 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 [ Info: Scanning for test items in project `TestOnlyDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 01:34:02 | maxrss 2.0% | mem 2.0% | START (1/2) test item "use a test-only dep" at test/deps_tests.jl:1 01:34:02 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "use a test-only dep" <0.1 secs (<0.1% compile), 3.03 K allocs (186.656 KB) 01:34:02 | maxrss 2.0% | mem 2.0% | START (2/2) test item "deps as expected" at test/deps_tests.jl:6 01:34:02 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "deps as expected" <0.1 secs (<0.1% compile), 2.18 K allocs (121.696 KB) [ Tests Completed: 2/2 test items were run. Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.11/activate_set.jl:78 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 9 tests on pid 15 01:34:02 | maxrss 2.0% | mem 2.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 01:34:02 | maxrss 2.0% | mem 2.0% | DONE (1/9) test item "do_thing Pass" <0.1 secs (72.1% compile), 13.23 K allocs (715.240 KB) 01:34:02 | maxrss 2.0% | mem 2.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 01:34:02 | maxrss 2.0% | mem 2.0% | DONE (2/9) test item "do_thing Fail" 0.4 secs (98.2% compile), 116.28 K allocs (6.661 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.25979806960074403, 0.2195660068742178, 0.10385598527114748] == 1 01:34:03 | maxrss 2.0% | mem 2.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 01:34:04 | maxrss 2.0% | mem 2.0% | DONE (3/9) test item "do_thing Error" 1.6 secs (50.4% compile, 0.9% GC), 989.38 K allocs (65.053 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 01:34:04 | maxrss 2.0% | mem 2.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 01:34:05 | maxrss 2.0% | mem 2.0% | DONE (4/9) test item "bad setup, good test" 0.6 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:298 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [27] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [28] #106 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:225 [inlined] [29] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:194 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 01:34:05 | maxrss 2.0% | mem 2.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 01:34:05 | maxrss 2.0% | mem 2.0% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:298 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [27] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [28] #106 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:225 [inlined] [29] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [31] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:194 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [45] include @ ./sysimg.jl:38 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [48] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [51] include(fname::String) @ Main ./sysimg.jl:38 01:34:05 | maxrss 2.0% | mem 2.0% | START (6/9) test item "errors" at test/error_tests.jl:1 01:34:07 | maxrss 2.0% | mem 2.0% | DONE (6/9) test item "errors" 1.3 secs (16.3% compile, 2.8% GC), 46.88 K allocs (3.123 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#448"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#448"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [15] redirect_stdio @ ./stream.jl:1416 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [23] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [26] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [30] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:298 [31] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [32] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [33] #106 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:225 [inlined] [34] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [36] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [43] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] --- the above 2 lines are repeated 1 more time --- [47] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:194 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [50] include @ ./sysimg.jl:38 [inlined] [51] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [52] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [55] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [56] include(fname::String) @ Main ./sysimg.jl:38 01:34:07 | maxrss 2.0% | mem 2.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 01:34:07 | maxrss 2.0% | mem 2.0% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [7] redirect_stdio @ ./stream.jl:1416 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [15] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [18] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:298 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [24] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [25] #106 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:225 [inlined] [26] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [28] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [33] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [35] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:194 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [42] include @ ./sysimg.jl:38 [inlined] [43] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [44] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [47] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [48] include(fname::String) @ Main ./sysimg.jl:38 [49] top-level scope @ none:6 01:34:07 | maxrss 2.0% | mem 2.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 01:34:07 | maxrss 2.0% | mem 2.0% | DONE (8/9) test item "nonexistent test setup" 0.3 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [6] redirect_stdio @ ./stream.jl:1416 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [14] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [17] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:298 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [24] #106 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:225 [inlined] [25] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#73#76"{var"#106#283"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#72#75"{var"#106#283"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#71#74"{var"#106#283", String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#106#283", name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:224 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:194 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 01:34:07 | maxrss 2.0% | mem 2.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 01:34:08 | maxrss 2.0% | mem 2.0% | DONE (9/9) test item "failures" <0.1 secs (83.3% compile), 12.31 K allocs (607.440 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.1398538224392761 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.11/activate_set.jl:78 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:10 | maxrss 2.0% | mem 2.0% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 01:41:12 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "MonoRepo tests" 2.5 secs (<0.1% compile, 0.5% GC), 75.79 K allocs (8.417 MB) [ Tests Completed: 1/1 test items were run. Testing C ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.11/Pkg/src/Operations.jl:1924 Status `/tmp/jl_HSMHvL/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [8dfed614] Test v1.11.0 Status `/tmp/jl_HSMHvL/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.35.0 `~/.julia/packages/ReTestItems/5fo5Q` [1e6cf692] TestEnv v1.103.2 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [deac9b47] LibCURL_jll v8.6.0+0 [e37daf67] LibGit2_jll v1.7.2+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.6+0 [14a3606d] MozillaCACerts_jll v2023.12.12 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.59.0+0 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.02 seconds. [ Info: Scheduling 1 tests on pid 222 01:41:36 | maxrss 2.0% | mem 2.8% | START (1/1) test item "C_tests" at test/c_tests.jl:1 01:41:37 | maxrss 2.0% | mem 2.8% | DONE (1/1) test item "C_tests" 0.2 secs (94.8% compile), 44.81 K allocs (2.457 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 3.5s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.2s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1206 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/h9a3r/src/julia-1.11/activate_set.jl:78 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:38 | maxrss 2.0% | mem 2.0% | START (1/1) test item "C_tests" at test/c_tests.jl:1 01:41:38 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 2.28 K allocs (115.080 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:38 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 01:41:38 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:40 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 01:41:40 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:40 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 01:41:40 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 01:41:40 | maxrss 2.0% | mem 2.0% | START (1/2) test item "bar" at src/bar_tests.jl:1 01:41:40 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 01:41:40 | maxrss 2.0% | mem 2.0% | START (2/2) test item "foo" at src/foo_test.jl:1 01:41:40 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.94 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:42 | maxrss 2.0% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 01:41:42 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 01:41:42 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 01:41:42 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 15 01:41:43 | maxrss 2.0% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.92 K allocs (135.576 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.62 K allocs (84.544 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.97 K allocs (174.720 KB) 01:41:43 | maxrss 2.0% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 01:41:43 | maxrss 2.0% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 2.15 K allocs (104.376 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:152 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:41:45 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:45 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:41:45 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:45 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:45 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:45 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.02 seconds. [ Info: Scheduling 2 tests on pid 15 01:41:46 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:46 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:46 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:46 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scheduling 2 tests on pid 15 01:41:48 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:48 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:48 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:48 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:48 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:48 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:48 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:48 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:50 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:50 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:41:50 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:50 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:41:50 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:50 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:50 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:50 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.98 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:52 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:52 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.93 seconds. [ Info: Scheduling 1 tests on pid 15 01:41:53 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:53 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.95 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:41:55 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 01:41:55 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 01:41:55 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:41:55 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:41:55 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:41:55 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.96 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.93 seconds. [ Info: Scheduling 3 tests on pid 15 01:42:02 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:42:02 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:42:02 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 01:42:02 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:42:02 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:42:02 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 15 01:42:02 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:42:02 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:42:02 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:42:02 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:02 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.03 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.16 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.03 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scheduling 3 tests on pid 15 01:42:12 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 01:42:12 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) 01:42:12 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 01:42:12 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.62 K allocs (84.792 KB) 01:42:12 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 01:42:12 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.62 K allocs (84.808 KB) [ Tests Completed: 3/3 test items were run. 01:42:12 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 01:42:12 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 5.55 K allocs (239.544 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:597 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 226: [ Info: Starting test worker 1 on pid = 226, with 2 threads\n[ Info: Starting running test items\n Worker 226: 01:42:30 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 226: 01:42:34 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 3.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965\n [10] #91\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1453\n [12] redirect_stdio\n @ ./stream.jl:1416 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108\n [18] top-level scope\n @ none:1\n\n Worker 226: 01:42:36 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 226: 01:42:36 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965\n [10] #91\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1453\n [12] redirect_stdio\n @ ./stream.jl:1416 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=226).\n Worker 226: [226] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:597 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:585 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:603 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 226: [ Info: Starting test worker 1 on pid = 226, with 2 threads\n[ Info: Starting running test items\n Worker 226: 01:42:30 | maxrss 2.0% | mem 2.8% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 226: 01:42:34 | maxrss 2.0% | mem 3.0% | DONE (1/2) test item \"bad setup, good test\" 3.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965\n [10] #91\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1453\n [12] redirect_stdio\n @ ./stream.jl:1416 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108\n [18] top-level scope\n @ none:1\n\n Worker 226: 01:42:36 | maxrss 2.0% | mem 3.0% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 226: 01:42:36 | maxrss 2.0% | mem 3.0% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2296 [inlined]\n [2] macro expansion\n @ ./lock.jl:273 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2271\n [4] #invoke_in_world#3\n @ ./essentials.jl:1089 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:1086 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2260\n [7] eval\n @ ./boot.jl:430 [inlined]\n [8] #92\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#92#95\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965\n [10] #91\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1453\n [12] redirect_stdio\n @ ./stream.jl:1416 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#91#94\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined]\n [15] macro expansion\n @ ./lock.jl:273 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108\n [18] top-level scope\n @ none:1\n\n[ Info: All tests completed. Closing Worker(pid=226).\n Worker 226: [226] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:603 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:585 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 241: [ Info: Starting test worker 1 on pid = 241, with 2 threads [ Info: Starting running test items Worker 241: 01:43:29 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 241: [241] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x79951a3e9bfa) __libc_calloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 241 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 241 ┌ Error: Worker(pid=241, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 246: [ Info: Starting test worker on pid = 246, with 2 threads Worker 246: 01:43:45 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 246: 01:43:47 | maxrss 2.1% | mem 2.8% | DONE (1/6) test item "Pass on second run" 0.2 secs (93.8% compile), 6.93 K allocs (342.968 KB) Worker 246: [246] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 246 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 246 ┌ Error: Worker(pid=246, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 251: [ Info: Starting test worker on pid = 251, with 2 threads Worker 251: 01:44:02 | maxrss 2.1% | mem 2.8% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 251: 01:44:03 | maxrss 2.1% | mem 2.8% | DONE (1/6) test item "Pass on second run" 0.1 secs (93.5% compile), 6.93 K allocs (342.968 KB) Worker 251: [251] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 251 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 251 ┌ Error: Worker(pid=251, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 256: [ Info: Starting test worker on pid = 256, with 2 threads Worker 256: 01:44:17 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 256 [256] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:25 _ZNK4llvm5Value33stripPointerCastsForAliasAnalysisEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult10aliasCheckEPKNS_5ValueENS_12LocationSizeES3_S4_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm9AAResults5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult8aliasGEPEPKNS_11GEPOperatorENS_12LocationSizeEPKNS_5ValueES4_S7_S7_RNS_11AAQueryInfoE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult19aliasCheckRecursiveEPKNS_5ValueENS_12LocationSizeES3_S4_RNS_11AAQueryInfoES3_S3_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult10aliasCheckEPKNS_5ValueENS_12LocationSizeES3_S4_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm13BasicAAResult5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm9AAResults5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm23MemoryDependenceResults30getSimplePointerDependencyFromERKNS_14MemoryLocationEbNS_14ilist_iteratorINS_12ilist_detail12node_optionsINS_11InstructionELb1ELb0EvEELb0ELb0EEEPNS_10BasicBlockEPS7_PjRNS_14BatchAAResultsE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm23MemoryDependenceResults24getPointerDependencyFromERKNS_14MemoryLocationEbNS_14ilist_iteratorINS_12ilist_detail12node_optionsINS_11InstructionELb1ELb0EvEELb0ELb0EEEPNS_10BasicBlockEPS7_PjRNS_14BatchAAResultsE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm23MemoryDependenceResults23getNonLocalInfoForBlockEPNS_11InstructionERKNS_14MemoryLocationEbPNS_10BasicBlockEPSt6vectorINS_16NonLocalDepEntryESaIS9_EEjRNS_14BatchAAResultsE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm23MemoryDependenceResults27getNonLocalPointerDepFromBBEPNS_11InstructionERKNS_12PHITransAddrERKNS_14MemoryLocationEbPNS_10BasicBlockERNS_15SmallVectorImplINS_17NonLocalDepResultEEERNS_8DenseMapISA_PNS_5ValueENS_12DenseMapInfoISA_vEENS_6detail12DenseMapPairISA_SH_EEEEbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm23MemoryDependenceResults28getNonLocalPointerDependencyEPNS_11InstructionERNS_15SmallVectorImplINS_17NonLocalDepResultEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm7GVNPass19processNonLocalLoadEPNS_8LoadInstE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm7GVNPass18processInstructionEPNS_11InstructionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=256, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 261: [ Info: Starting test worker on pid = 261, with 2 threads Worker 261: 01:44:33 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 261 [261] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:25 _ZNK4llvm11Instruction12getSuccessorEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15SmallVectorImplIPNS_10BasicBlockEE6appendISt16reverse_iteratorINS_12SuccIteratorINS_11InstructionES1_EEEvEEvT_SA_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm14DomTreeBuilder11SemiNCAInfoINS_17DominatorTreeBaseINS_10BasicBlockELb0EEEE11getChildrenILb0EEENS_11SmallVectorIPS3_Lj8EEES8_PNS5_15BatchUpdateInfoE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=261, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 266: [ Info: Starting test worker on pid = 266, with 2 threads Worker 266: 01:44:50 | maxrss 2.1% | mem 2.8% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 266 [266] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:25 _ZN4llvm15SCCPInstVisitor12mergeInValueEPNS_5ValueENS_19ValueLatticeElementENS3_12MergeOptionsE.isra.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15SCCPInstVisitor19visitBinaryOperatorERNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15SCCPInstVisitor18markUsersAsChangedEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15SCCPInstVisitor5solveEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) ┌ Error: Worker(pid=266, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 271: [ Info: Starting test worker on pid = 271, with 2 threads Worker 271: 01:45:06 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 271: 01:45:07 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.8% compile), 6.84 K allocs (339.408 KB) Worker 271: [271] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 271 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 271 ┌ Error: Worker(pid=271, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 276: [ Info: Starting test worker on pid = 276, with 2 threads Worker 276: 01:45:22 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 276: 01:45:24 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (93.8% compile), 6.84 K allocs (339.408 KB) Worker 276: [276] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 276 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 276 ┌ Error: Worker(pid=276, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 281: [ Info: Starting test worker on pid = 281, with 2 threads Worker 281: 01:45:38 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 281: 01:45:40 | maxrss 2.1% | mem 2.8% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (94.1% compile), 6.84 K allocs (339.408 KB) Worker 281: [281] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 281 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 281 ┌ Error: Worker(pid=281, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 286: [ Info: Starting test worker on pid = 286, with 2 threads Worker 286: 01:45:55 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 286: [286] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 286 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 286 ┌ Error: Worker(pid=286, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 291: [ Info: Starting test worker on pid = 291, with 2 threads Worker 291: 01:46:11 | maxrss 2.1% | mem 2.8% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 291: [291] signal 15: Terminated in expression starting at none:1 _ZN4llvm12SelectionDAG11getRegisterEjNS_3EVTE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 291 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 291 ┌ Error: Worker(pid=291, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 296: [ Info: Starting test worker on pid = 296, with 2 threads Worker 296: 01:46:28 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 296: [296] signal 15: Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 296 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 296 ┌ Error: Worker(pid=296, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 301: [ Info: Starting test worker on pid = 301, with 2 threads Worker 301: 01:46:44 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 301: [301] signal 15: Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 301 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 301 ┌ Error: Worker(pid=301, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 306: [ Info: Starting test worker on pid = 306, with 2 threads Worker 306: 01:47:00 | maxrss 2.1% | mem 2.8% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 306: 01:47:02 | maxrss 2.1% | mem 2.8% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (94.1% compile), 6.84 K allocs (339.408 KB) Worker 306: [306] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 306 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 306 ┌ Error: Worker(pid=306, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 311: [ Info: Starting test worker on pid = 311, with 2 threads Worker 311: 01:47:17 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 311 [311] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x786f4c23ef14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=311, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 316: [ Info: Starting test worker on pid = 316, with 2 threads Worker 316: 01:47:34 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 316 [316] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7906ef341f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=316, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 321: [ Info: Starting test worker on pid = 321, with 2 threads Worker 321: 01:47:50 | maxrss 2.1% | mem 2.8% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 321 [321] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x790544bbaf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=321, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 326: [ Info: Starting test worker on pid = 326, with 2 threads Worker 326: 01:48:06 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 326 [326] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x7dfec5a91f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=326, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 331: [ Info: Starting test worker on pid = 331, with 2 threads Worker 331: 01:48:23 | maxrss 2.1% | mem 2.8% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 331: 01:48:23 | maxrss 2.1% | mem 2.8% | DONE (6/6) test item "Timeout first, pass after" 0.4 secs (96.3% compile, 13.2% GC), 100.83 K allocs (5.355 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=331). Worker 331: [331] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:663 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:663 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:665 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:665 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:668 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:668 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:671 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:671 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:681 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:681 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:652 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:859 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:859 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 336: [ Info: Starting test worker 1 on pid = 336, with 2 threads [ Info: Starting running test items Worker 336: 01:48:41 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 336 [336] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x798fd3e57f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=336, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 341: [ Info: Starting test worker on pid = 341, with 2 threads Worker 341: 01:48:56 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 341: 01:48:57 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (93.5% compile), 20.62 K allocs (1.093 MB) Worker 341: [341] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 341 ┌ Error: Worker(pid=341, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=341, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:754 | Worker 1 closed: Worker(pid=341, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:721 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:721 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:714 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:713 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:723 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:714 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 DEBUG @ ReTestItems.jl:374 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/Project.toml` DEBUG @ ReTestItems.jl:383 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:409 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestOnlyDeps.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:831 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:859 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:859 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:411 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 346: [ Info: Starting test worker 1 on pid = 346, with 2 threads [ Info: Starting running test items Worker 346: 01:49:13 | maxrss 2.1% | mem 2.8% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 346 [346] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7b664a6c1f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 ┌ Error: Worker(pid=346, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 351: [ Info: Starting test worker on pid = 351, with 2 threads Worker 351: 01:49:28 | maxrss 2.1% | mem 2.8% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 351: 01:49:28 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (94.6% compile), 20.62 K allocs (1.093 MB) Worker 351: [351] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 351 ┌ Error: Worker(pid=351, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=351, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:754 | Worker 1 closed: Worker(pid=351, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:507 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:511 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:520 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:522 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:743 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:743 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:734 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:733 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1554 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1545 [3] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:745 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [7] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [8] include @ ./sysimg.jl:38 [inlined] [9] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [10] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [11] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [14] include(fname::String) @ Main ./sysimg.jl:38 [15] top-level scope @ none:6 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 356: [ Info: Starting test worker 1 on pid = 356, with 2 threads [ Info: Starting running test items Worker 356: 01:49:44 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 356 [356] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7d03620bcf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x7d0359539e45) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 #99 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 #redirect_stdio#837 at ./stream.jl:1453 redirect_stdio at ./stream.jl:1416 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 unknown function (ip: 0x7d03595384ce) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:348 unknown function (ip: 0x7d0359517bca) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1204 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=356, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=356, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 361: [ Info: Starting test worker 1 on pid = 361, with 2 threads [ Info: Starting running test items Worker 361: 01:50:01 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 361 [361] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x754ccf816f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x754cc2937e35) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 #99 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 #redirect_stdio#837 at ./stream.jl:1453 redirect_stdio at ./stream.jl:1416 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 unknown function (ip: 0x754cc29364be) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:348 unknown function (ip: 0x754cc2915bca) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1204 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=361, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=361, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 366: [ Info: Starting test worker 1 on pid = 366, with 2 threads [ Info: Starting running test items Worker 366: 01:50:19 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 366 [366] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x784b35999f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 poptask at ./task.jl:1012 wait at ./task.jl:1021 #wait#733 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:145 wait at ./asyncevent.jl:162 [inlined] sleep at ./asyncevent.jl:272 unknown function (ip: 0x784b2cd39e35) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_eval_module_expr at /source/src/toplevel.c:215 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:743 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] #100 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 #99 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 #redirect_stdio#837 at ./stream.jl:1453 redirect_stdio at ./stream.jl:1416 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 #33 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] #open#465 at ./io.jl:410 open at ./io.jl:407 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] #runtestitem#98 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 unknown function (ip: 0x784b2cd384be) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] execute at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:334 [inlined] #22 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/workers.jl:348 unknown function (ip: 0x784b2cd17bca) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] start_task at /source/src/task.c:1204 unknown function (ip: (nil)) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 ┌ Error: Worker(pid=366, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=366, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 376: [ Info: Starting test worker 1 on pid = 376, with 3,2 threads [ Info: Starting running test items Worker 376: 01:50:54 | maxrss 2.1% | mem 2.8% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 376: 01:50:54 | maxrss 2.1% | mem 2.8% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (94.2% compile), 27.05 K allocs (1.413 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=376). Worker 376: [376] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:820 overwritten at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:854. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.07 seconds. [ Info: Scheduling 3 tests on pid 15 01:50:58 | maxrss 2.1% | mem 2.0% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 01:50:58 | maxrss 2.1% | mem 2.0% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.856 KB) 01:50:58 | maxrss 2.1% | mem 2.0% | START (2/3) test item "other A" at test/integrationtests.jl:846 01:50:58 | maxrss 2.1% | mem 2.0% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) 01:50:58 | maxrss 2.1% | mem 2.0% | START (3/3) test item "other B" at test/integrationtests.jl:846 01:50:58 | maxrss 2.1% | mem 2.0% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:50:58 | maxrss 2.1% | mem 2.0% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 01:50:58 | maxrss 2.1% | mem 2.0% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.68 K allocs (86.856 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 01:50:59 | maxrss 2.1% | mem 2.0% | START (1/2) test item "other A" at test/integrationtests.jl:846 01:50:59 | maxrss 2.1% | mem 2.0% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) 01:50:59 | maxrss 2.1% | mem 2.0% | START (2/2) test item "other B" at test/integrationtests.jl:846 01:50:59 | maxrss 2.1% | mem 2.0% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 01:50:59 | maxrss 2.1% | mem 2.0% | START (1/1) test item "other B" at test/integrationtests.jl:846 01:50:59 | maxrss 2.1% | mem 2.0% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.81 K allocs (96.096 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.63 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 01:51:00 | maxrss 2.1% | mem 2.1% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 01:51:00 | maxrss 2.1% | mem 2.1% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.752 KB) 01:51:00 | maxrss 2.1% | mem 2.1% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 01:51:00 | maxrss 2.1% | mem 2.1% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.752 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 384: [ Info: Starting test worker 1 on pid = 384, with 2 threads [ Info: Starting running test items Worker 384: 01:51:15 | maxrss 2.1% | mem 2.8% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 384: 01:51:16 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "same name" 0.2 secs (94.0% compile), 20.62 K allocs (1.093 MB) Worker 384: 01:51:16 | maxrss 2.1% | mem 2.8% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 384: 01:51:16 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.62 K allocs (84.880 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=384). Worker 384: [384] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7a95a271cf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 389: [ Info: Starting test worker 1 on pid = 389, with 2 threads [ Info: Starting running test items Worker 389: [389] signal 15: Terminated in expression starting at none:1 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 389 ┌ Error: Worker(pid=389, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 Worker 394: [ Info: Starting test worker on pid = 394, with 2 threads Worker 394: [394] signal 15: Terminated in expression starting at none:1 _ZN4llvm17IDFCalculatorBaseINS_17MachineBasicBlockELb0EE9calculateERNS_15SmallVectorImplIPS1_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN15LiveDebugValues16InstrRefBasedLDV17BlockPHIPlacementERKN4llvm15SmallPtrSetImplIPNS1_17MachineBasicBlockEEES7_RNS1_15SmallVectorImplIS4_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 394 ┌ Error: Worker(pid=394, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716 [ Info: All tests on worker 1 completed. Closing Worker(pid=394, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:57:30 | maxrss 2.1% | mem 2.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) 01:57:30 | maxrss 2.1% | mem 2.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) 01:57:30 | maxrss 2.1% | mem 2.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.52 K allocs (117.888 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 01:57:30 | maxrss 2.1% | mem 2.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 15 Error in testset "happy 1" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 01:57:30 | maxrss 2.1% | mem 2.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 15 Error in testset "happy 2" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 01:57:30 | maxrss 2.1% | mem 2.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 01:57:30 | maxrss 2.1% | mem 2.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.648 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 15 Error in testset "happy 3" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 516: [ Info: Starting test worker 1 on pid = 516, with 2 threads [ Info: Starting running test items Worker 516: 01:57:44 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 516: 01:57:45 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (92.2% compile), 21.24 K allocs (1.109 MB) Worker 516: 01:57:46 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 516: 01:57:46 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.53 K allocs (118.016 KB) Worker 516: 01:57:46 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 516: 01:57:46 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.016 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=516). Worker 516: [516] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 521: [ Info: Starting test worker 1 on pid = 521, with 2 threads [ Info: Starting running test items Worker 521: 01:58:00 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 521: 01:58:01 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.9% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 521 Error in testset "happy 1" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 521: 01:58:02 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 521: 01:58:02 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.14 K allocs (103.776 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 521 Error in testset "happy 2" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 521: 01:58:03 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 521: 01:58:03 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.776 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 521 Error in testset "happy 3" on worker 521: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=521). Worker 521: [521] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 526: [ Info: Starting test worker 1 on pid = 526, with 2 threads Worker 528: [ Info: Starting test worker 2 on pid = 528, with 2 threads [ Info: Starting running test items Worker 526: 01:58:31 | maxrss 2.1% | mem 3.5% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 528: 01:58:31 | maxrss 2.1% | mem 3.5% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 528: 01:58:32 | maxrss 2.1% | mem 3.5% | DONE (2/3) test item "happy 2" 0.4 secs (94.5% compile), 21.24 K allocs (1.109 MB) Worker 526: 01:58:32 | maxrss 2.1% | mem 3.5% | DONE (1/3) test item "happy 1" 0.4 secs (94.1% compile), 21.24 K allocs (1.109 MB) Worker 526: 01:58:34 | maxrss 2.1% | mem 3.4% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 [ Info: All tests on worker 2 completed. Closing Worker(pid=528). Worker 526: 01:58:34 | maxrss 2.1% | mem 3.4% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.53 K allocs (118.048 KB) Worker 528: [528] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7409074b7f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Info: All tests on worker 1 completed. Closing Worker(pid=526). Worker 526: [526] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 536: [ Info: Starting test worker 1 on pid = 536, with 2 threads Worker 538: [ Info: Starting test worker 2 on pid = 538, with 2 threads [ Info: Starting running test items Worker 538: 01:59:10 | maxrss 2.1% | mem 3.4% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 536: 01:59:10 | maxrss 2.1% | mem 3.4% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 538: 01:59:13 | maxrss 2.1% | mem 3.4% | DONE (2/3) test item "happy 2" 0.4 secs (94.3% compile), 20.85 K allocs (1.095 MB) Worker 536: 01:59:13 | maxrss 2.1% | mem 3.4% | DONE (1/3) test item "happy 1" 0.4 secs (93.0% compile), 20.85 K allocs (1.095 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 538 Error in testset "happy 2" on worker 538: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 Worker 538: 01:59:14 | maxrss 2.1% | mem 3.4% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 538: 01:59:14 | maxrss 2.1% | mem 3.4% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.14 K allocs (103.776 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 538 Error in testset "happy 3" on worker 538: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 536 Error in testset "happy 1" on worker 536: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1065 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=538). Worker 538: [538] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7f2a7c39cf14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:584 [ Info: All tests on worker 1 completed. Closing Worker(pid=536). Worker 536: [536] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 546: [ Info: Starting test worker 1 on pid = 546, with 2 threads [ Info: Starting running test items Worker 546: 01:59:30 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 546: 01:59:30 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.2 secs (93.0% compile), 21.33 K allocs (1.121 MB) Worker 546: 01:59:31 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 546: 01:59:31 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.05 K allocs (100.432 KB) Worker 546: 01:59:31 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 546: 01:59:31 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.05 K allocs (100.432 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=546). Worker 546: [546] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1088 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 16.1s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1088 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 551: [ Info: Starting test worker 1 on pid = 551, with 2 threads [ Info: Starting running test items Worker 551: 01:59:47 | maxrss 2.1% | mem 2.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 551: 01:59:48 | maxrss 2.1% | mem 2.8% | DONE (1/3) test item "happy 1" 0.4 secs (95.5% compile, 12.1% GC), 58.57 K allocs (3.270 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 551 Error in testset "post-testitem" on worker 551: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1099 Expression: false Worker 551: 01:59:49 | maxrss 2.1% | mem 2.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 551: 01:59:49 | maxrss 2.1% | mem 2.8% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.02 K allocs (138.672 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 551 Error in testset "post-testitem" on worker 551: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1099 Expression: false Worker 551: 01:59:49 | maxrss 2.1% | mem 2.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 551: 01:59:49 | maxrss 2.1% | mem 2.8% | DONE (3/3) test item "happy 3" <0.1 secs (2.0% compile), 3.02 K allocs (138.672 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 551 Error in testset "post-testitem" on worker 551: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1099 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=551). Worker 551: [551] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1110 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.8s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1110 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1117 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 17.8s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1117 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1076 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1045 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 Activating project at `~/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl` [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 556: [ Info: Starting test worker 1 on pid = 556, with 2 threads [ Info: Starting running test items Worker 556: 02:00:05 | maxrss 2.1% | mem 2.7% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 556: 02:00:06 | maxrss 2.1% | mem 2.7% | DONE (1/2) test item "correct usage" 0.3 secs (96.8% compile), 61.46 K allocs (3.217 MB) Worker 556: 02:00:06 | maxrss 2.1% | mem 2.7% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 556: 02:00:06 | maxrss 2.1% | mem 2.7% | DONE (2/2) test item "incorrect usage" <0.1 secs (71.1% compile), 2.89 K allocs (149.752 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=556). Worker 556: [556] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 561: [ Info: Starting test worker 1 on pid = 561, with 2 threads [ Info: Starting running test items Worker 561: 02:00:21 | maxrss 2.1% | mem 2.8% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 561: 02:00:22 | maxrss 2.1% | mem 2.8% | DONE (1/2) test item "correct usage" 0.7 secs (97.2% compile, 7.3% GC), 212.35 K allocs (11.377 MB) Worker 561: 02:00:23 | maxrss 2.1% | mem 2.8% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 561: 02:00:24 | maxrss 2.1% | mem 2.8% | DONE (2/2) test item "incorrect usage" <0.1 secs (56.1% compile), 4.66 K allocs (222.416 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 561 Error in testset "no pins left at end of test" on worker 561: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1143 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=561). Worker 561: [561] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x784559204f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 15 02:00:25 | maxrss 2.1% | mem 2.1% | START (1/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 02:00:25 | maxrss 2.1% | mem 2.1% | DONE (1/9) test item "do_thing Fail" 0.2 secs (95.2% compile, 70.1% recompile), 64.11 K allocs (3.588 MB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 15 [ Info: RUNNING Error in testset "do_thing Fail" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.10798021726669049, 0.8560515102243852, 0.16649439121613896] == 1 02:00:25 | maxrss 2.1% | mem 2.1% | START (2/9) test item "do_thing Error" at src/do_thing_tests.jl:7 02:00:26 | maxrss 2.1% | mem 2.1% | DONE (2/9) test item "do_thing Error" 0.8 secs (<0.1% compile), 259.28 K allocs (23.836 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 15 [ Info: RUNNING Error in testset "do_thing Error" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:596 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:322 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/src/do_thing_tests.jl:8 02:00:26 | maxrss 2.1% | mem 2.1% | START (3/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 02:00:26 | maxrss 2.1% | mem 2.1% | DONE (3/9) test item "bad setup, good test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 15 Error in testset "bad setup, good test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [26] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [27] #208 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1165 [inlined] [28] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1164 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1159 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1156 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 02:00:26 | maxrss 2.1% | mem 2.1% | START (4/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 02:00:26 | maxrss 2.1% | mem 2.1% | DONE (4/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 15 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 15 Error in testset "bad setup, bad test" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] eval @ ./boot.jl:430 [inlined] [8] #92 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [9] with_source_path(f::ReTestItems.var"#92#95"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [10] #91 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1003 [inlined] [11] redirect_stdio(f::ReTestItems.var"#91#94"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [12] redirect_stdio @ ./stream.jl:1416 [inlined] [13] _redirect_logs(f::ReTestItems.var"#91#94"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1002 [inlined] [15] macro expansion @ ./lock.jl:273 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:977 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1108 [18] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [20] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [21] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [22] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [26] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [27] #208 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1165 [inlined] [28] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [30] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1164 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1159 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1156 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [44] include @ ./sysimg.jl:38 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [50] include(fname::String) @ Main ./sysimg.jl:38 02:00:26 | maxrss 2.1% | mem 2.1% | START (5/9) test item "errors" at test/error_tests.jl:1 02:00:28 | maxrss 2.1% | mem 2.1% | DONE (5/9) test item "errors" 1.0 secs (<0.1% compile), 25.29 K allocs (1.881 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#866"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#866"` Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:677 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2296 [inlined] [2] macro expansion @ ./lock.jl:273 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2271 [4] #invoke_in_world#3 @ ./essentials.jl:1089 [inlined] [5] invoke_in_world @ ./essentials.jl:1086 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:2260 [7] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:430 [inlined] [11] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [12] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [13] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [14] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [15] redirect_stdio @ ./stream.jl:1416 [inlined] [16] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [17] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [19] open @ ./io.jl:407 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [23] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [25] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [26] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [27] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [30] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [31] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [32] #208 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1165 [inlined] [33] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [35] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [42] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1164 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1159 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1156 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [48] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [49] include @ ./sysimg.jl:38 [inlined] [50] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [51] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [52] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [54] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [55] include(fname::String) @ Main ./sysimg.jl:38 02:00:28 | maxrss 2.1% | mem 2.1% | START (6/9) test item "errors at the top level" at test/error_tests.jl:17 02:00:28 | maxrss 2.1% | mem 2.1% | DONE (6/9) test item "errors at the top level" 0.3 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 15 [ Info: RUNNING Error in testset "errors at the top level" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:430 [inlined] [3] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [4] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [5] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [6] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [7] redirect_stdio @ ./stream.jl:1416 [inlined] [8] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [9] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [11] open @ ./io.jl:407 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [15] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [17] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [18] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [23] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [24] #208 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1165 [inlined] [25] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [27] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [32] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1164 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1159 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1156 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [41] include @ ./sysimg.jl:38 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [47] include(fname::String) @ Main ./sysimg.jl:38 [48] top-level scope @ none:6 02:00:28 | maxrss 2.1% | mem 2.1% | START (7/9) test item "nonexistent test setup" at test/error_tests.jl:23 02:00:28 | maxrss 2.1% | mem 2.1% | DONE (7/9) test item "nonexistent test setup" 0.3 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 15 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 15: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Stacktrace: [1] eval @ ./boot.jl:430 [inlined] [2] #100 @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [inlined] [3] with_source_path(f::ReTestItems.var"#100#104"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:965 [4] (::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1142 [5] redirect_stdio(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1453 [6] redirect_stdio @ ./stream.jl:1416 [inlined] [7] _redirect_logs(f::ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:124 [8] #33 @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#33#34"{ReTestItems.var"#99#103"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:410 [10] open @ ./io.jl:407 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1139 [14] runtestitem @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:1061 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:446 [16] (::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:394 [17] with_logstate(f::ReTestItems.var"#55#56"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:526 [18] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:637 [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:377 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool, failures_first::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:347 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [22] runtests @ ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:268 [inlined] [23] #208 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1165 [inlined] [24] #73 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#73#76"{var"#208#388"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.11/Pkg/src/API.jl:1379 [26] #72 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#72#75"{var"#208#388"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #71 @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [31] encased_testset(f::var"#71#74"{var"#208#388"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#208#388"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:31 [33] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1164 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1159 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1156 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [39] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [40] include @ ./sysimg.jl:38 [inlined] [41] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 [42] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [43] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:17 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [45] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:15 [46] include(fname::String) @ Main ./sysimg.jl:38 [47] top-level scope @ none:6 02:00:28 | maxrss 2.1% | mem 2.1% | START (8/9) test item "failures" at test/failure_tests.jl:1 02:00:28 | maxrss 2.1% | mem 2.1% | DONE (8/9) test item "failures" <0.1 secs (<0.1% compile), 3.57 K allocs (169.992 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 15 [ Info: RUNNING Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.07577585096958431 < 0 Error in testset "failures" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE 02:00:28 | maxrss 2.1% | mem 2.1% | START (9/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 02:00:28 | maxrss 2.1% | mem 2.1% | DONE (9/9) test item "do_thing Pass" <0.1 secs (<0.1% compile), 2.47 K allocs (120.120 KB) [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 3.3s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.0s do_thing Fail | 1 1 0.2s do_thing Error | 1 1 0.8s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.4s bad setup, bad test | 1 1 0.4s test/error_tests.jl | 1 6 7 errors | 4 4 1.0s UndefVarError | 2 2 0.6s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.3s nonexistent test setup | 1 1 0.3s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1184. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1184 overwritten at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1215. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 6 tests on pid 15 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 611: [ Info: Starting test worker 1 on pid = 611, with 2 threads [ Info: Starting running test items Worker 611: 02:03:09 | maxrss 2.3% | mem 2.9% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 611: 02:03:09 | maxrss 2.3% | mem 2.9% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (93.3% compile), 20.62 K allocs (1.093 MB) Worker 611: 02:03:10 | maxrss 2.3% | mem 2.9% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 611: 02:03:11 | maxrss 2.3% | mem 2.9% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.97 K allocs (98.080 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 611 Error in testset "skip false, 1 pass, 1 fail" on worker 611: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_skip_tests.jl:8 Expression: false Worker 611: 02:03:11 | maxrss 2.3% | mem 2.9% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 611: 02:03:11 | maxrss 2.3% | mem 2.9% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 611: 02:03:11 | maxrss 2.3% | mem 2.9% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.97 K allocs (97.992 KB) Worker 611: 02:03:12 | maxrss 2.3% | mem 2.9% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 611: 02:03:13 | maxrss 2.3% | mem 2.9% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=611). Worker 611: [611] signal 15: Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1231 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 21.2s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.2s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1231 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1225 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_parse_error_test.jl 02:03:23 | maxrss 2.3% | mem 2.7% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_direct_testitem.jl:6 Test Summary: | Fail Total Time should fail | 1 1 5.0s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 627: [ Info: Starting test worker 2 on pid = 627, with 2 threads\n Worker 625: [ Info: Starting test worker 1 on pid = 625, with 2 threads\n Worker 629: [ Info: Starting test worker 3 on pid = 629, with 2 threads\n[ Info: Starting running test items\n Worker 625: [625] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c54aa32bf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 629: [629] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x794e46a1ff14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 627: [627] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e5fa5fd5f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 625\n┌ Error: Worker(pid=625, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 627\n┌ Error: Worker(pid=627, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 629\n┌ Error: Worker(pid=629, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 640: [ Info: Starting test worker on pid = 640, with 2 threads\n Worker 644: [ Info: Starting test worker on pid = 644, with 2 threads\n Worker 646: [ Info: Starting test worker on pid = 646, with 2 threads\n Worker 640: [640] signal 15: Terminated\nin expression starting at none:1\n_ZNSt6vectorISt4pairISt8optionalIN4llvm14WeakTrackingVHEEPNS2_13CallGraphNodeEESaIS7_EE17_M_realloc_insertIJS4_RS6_EEEvN9__gnu_cxx17__normal_iteratorIPS7_S9_EEDpOT_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm9CallGraph21populateCallGraphNodeEPNS_13CallGraphNodeE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm9CallGraphC2ERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 644: [644] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm13ScaledNumbers10multiply64Emm at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm26BlockFrequencyInfoImplBase15finalizeMetricsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm22BlockFrequencyInfoImplINS_17MachineBasicBlockEE9calculateERKNS_15MachineFunctionERKNS_28MachineBranchProbabilityInfoERKNS_15MachineLoopInfoE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm25MachineBlockFrequencyInfo9calculateERKNS_15MachineFunctionERKNS_28MachineBranchProbabilityInfoERKNS_15MachineLoopInfoE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n_ZN4llvm25MachineBlockFrequencyInfo20runOnMachineFunctionERNS_15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 640\n┌ Error: Worker(pid=640, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=640, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 644\n┌ Error: Worker(pid=644, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=644, terminated=true, termsignal=9).\n Worker 646: [646] signal 15: Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 646\n┌ Error: Worker(pid=646, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 3 completed. Closing Worker(pid=646, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 663: [ Info: Starting test worker 3 on pid = 663, with 2 threads\n Worker 660: [ Info: Starting test worker 1 on pid = 660, with 2 threads\n Worker 662: [ Info: Starting test worker 2 on pid = 662, with 2 threads\n[ Info: Starting running test items\n Worker 662: [662] signal 15: Terminated\nin expression starting at none:1\n_ZNK4llvm12LivePhysRegs9availableERKNS_19MachineRegisterInfoEt at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\nunknown function (ip: 0x83)\n\n Worker 660: [660] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e286b711f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 663: [663] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x79404537df14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 663\n┌ Error: Worker(pid=663, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 662\n┌ Error: Worker(pid=662, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 660\n┌ Error: Worker(pid=660, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 679: [ Info: Starting test worker on pid = 679, with 2 threads\n Worker 675: [ Info: Starting test worker on pid = 675, with 2 threads\n Worker 677: [ Info: Starting test worker on pid = 677, with 2 threads\n Worker 679: [679] signal 15: Terminated\nin expression starting at none:1\n_ZN4llvm34PreservedCFGCheckerInstrumentation3CFGC1EPKNS_8FunctionEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line)\n\n Worker 675: [675] signal 15: Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 679\n┌ Error: Worker(pid=679, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=679, terminated=true, termsignal=9).\n Worker 677: [677] signal 15: Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 675\n┌ Error: Worker(pid=675, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 3 completed. Closing Worker(pid=675, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 677\n┌ Error: Worker(pid=677, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=677, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1327 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 15 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 742: [ Info: Starting test worker 2 on pid = 742, with 2 threads\n Worker 740: [ Info: Starting test worker 1 on pid = 740, with 2 threads\n Worker 743: [ Info: Starting test worker 3 on pid = 743, with 2 threads\n[ Info: Starting running test items\n Worker 742: [742] signal 15: Terminated\nin expression starting at none:1\n\n Worker 740: [740] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x710f3da22f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n Worker 743: [743] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7294189d9f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\n\nNo Captured LogsNo Captured Logs for test item \"bad\" at for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:4test/testfiles/_failfast_crash_tests.jl:1 on worker 742\n┌ Error: Worker(pid=742, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n on worker 740[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\n┌ Error: Worker(pid=740, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 743\n┌ Error: Worker(pid=743, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 757: [ Info: Starting test worker on pid = 757, with 2 threads\n Worker 759: [ Info: Starting test worker on pid = 759, with 2 threads\n Worker 755: [ Info: Starting test worker on pid = 755, with 2 threads\n Worker 757: [757] signal 15: Terminated\nin expression starting at none:1\n\n Worker 759: [759] signal 15: Terminated\n\n Worker 755: [755] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7655a97ccf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\nijl_task_get_next at /source/src/scheduler.c:584\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 757\n┌ Error: Worker(pid=757, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=757, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 759\n┌ Error: Worker(pid=759, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 3 completed. Closing Worker(pid=759, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 755\n┌ Error: Worker(pid=755, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/5fo5Q/src/ReTestItems.jl:716\n[ Info: All tests on worker 2 completed. Closing Worker(pid=755, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:680 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1336 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1313 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1798 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1301 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:1299 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.11/Test/src/Test.jl:1709 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/5fo5Q/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 15 02:11:26 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 02:11:26 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 15 Error in testset "test set" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 15 running 1 of 1 signal (10): User defined signal 1 _ZN4llvm15ScalarEvolution15getExistingSCEVEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution14createSCEVIterEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution24computeExitLimitFromICmpEPKNS_4LoopEPNS_8ICmpInstEbbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution28computeExitLimitFromCondImplERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution30computeExitLimitFromCondCachedERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution24computeExitLimitFromCondEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution16computeExitLimitEPKNS_4LoopEPNS_10BasicBlockEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution25computeBackedgeTakenCountEPKNS_4LoopEb at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution20getBackedgeTakenInfoEPKNS_4LoopE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution11getRangeRefEPKNS_4SCEVENS0_13RangeSignHintEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZL21StrengthenNoWrapFlagsPN4llvm15ScalarEvolutionENS_9SCEVTypesENS_8ArrayRefIPKNS_4SCEVEEENS4_11NoWrapFlagsE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution10getAddExprERNS_15SmallVectorImplIPKNS_4SCEVEEENS2_11NoWrapFlagsEj at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 2 tests on pid 15 02:11:30 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 02:11:30 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 15 _ZN4llvm15ScalarEvolution10createSCEVEPNS_5ValueE.part.0 at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm15ScalarEvolution14createSCEVIterEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_119InductiveRangeCheck26extractRangeChecksFromCondEPN4llvm4LoopERNS1_15ScalarEvolutionERNS1_3UseERNS1_15SmallVectorImplIS0_EERNS1_15SmallPtrSetImplIPNS1_5ValueEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN12_GLOBAL__N_119InductiveRangeCheck26extractRangeChecksFromCondEPN4llvm4LoopERNS1_15ScalarEvolutionERNS1_3UseERNS1_15SmallVectorImplIS0_EERNS1_15SmallPtrSetImplIPNS1_5ValueEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) Error in testset "Failure at toplevel" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 02:11:30 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 02:11:30 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 15 _ZN12_GLOBAL__N_130InductiveRangeCheckElimination3runEPN4llvm4LoopENS1_12function_refIFvS3_bEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm8IRCEPass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 run at /source/usr/include/llvm/IR/PassManager.h:517 [inlined] run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) run at /source/src/pipeline.cpp:777 Error in testset "Bar" on worker 15: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. operator() at /source/src/jitlayers.cpp:1298 withModuleDo<(anonymous namespace)::OptimizerT::operator()(llvm::orc::ThreadSafeModule, llvm::orc::MaterializationResponsibility&) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] operator() at /source/src/jitlayers.cpp:1259 [inlined] CallImpl<(anonymous namespace)::OptimizerT<4> > at /source/usr/include/llvm/ADT/FunctionExtras.h:221 _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16IRTransformLayer4emitESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EENS0_16ThreadSafeModuleE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc31BasicIRLayerMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc19MaterializationTask3runEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm6detail18UniqueFunctionBaseIvJSt10unique_ptrINS_3orc4TaskESt14default_deleteIS4_EEEE8CallImplIPFvS7_EEEvPvRS7_ at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_vEEEENSG_ISD_vEENS_6detail12DenseMapPairISD_SI_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS_18JITEvaluatedSymbolENS_12DenseMapInfoISI_vEENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_vEENSN_IS6_SV_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) _ZN4llvm3orc16ExecutionSession6lookupERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS7_EENS0_15SymbolLookupSetENS0_10LookupKindENS0_11SymbolStateESt8functionIFvRKNS_8DenseMapIS5_NS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISI_vEEEENSJ_IS5_vEENS_6detail12DenseMapPairIS5_SL_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM-16jl.so (unknown line) addModule at /source/src/jitlayers.cpp:1875 jl_add_to_ee at /source/src/jitlayers.cpp:2306 _jl_compile_codeinst at /source/src/jitlayers.cpp:277 jl_generate_fptr_impl at /source/src/jitlayers.cpp:536 jl_compile_method_internal at /source/src/gf.c:2538 [inlined] jl_compile_method_internal at /source/src/gf.c:2425 _jl_invoke at /source/src/gf.c:2943 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_body at /source/src/interpreter.c:562 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2777 _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 _include at ./loading.jl:2837 include at ./sysimg.jl:38 [inlined] #2 at /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/runtests.jl:21 withenv at ./env.jl:265 unknown function (ip: 0x7c1f1ef08e43) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 eval_stmt_value at /source/src/interpreter.c:174 [inlined] eval_body at /source/src/interpreter.c:670 eval_body at /source/src/interpreter.c:539 eval_body at /source/src/interpreter.c:539 jl_interpret_toplevel_thunk at /source/src/interpreter.c:824 jl_toplevel_eval_flex at /source/src/toplevel.c:943 jl_toplevel_eval_flex at /source/src/toplevel.c:886 ijl_toplevel_eval_in at /source/src/toplevel.c:994 eval at ./boot.jl:430 [inlined] include_string at ./loading.jl:2777 _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 _include at ./loading.jl:2837 include at ./sysimg.jl:38 unknown function (ip: 0x7c1f1ef00082) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] do_call at /source/src/interpreter.c:126 eval_value at /source/src/interpreter.c:223 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/5fo5Q/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:522 poptask at ./task.jl:1012 wait at ./task.jl:1021 task_done_hook at ./task.jl:694 jfptr_task_done_hook_66687.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:2951 [inlined] ijl_apply_generic at /source/src/gf.c:3128 jl_apply at /source/src/julia.h:2157 [inlined] jl_finish_task at /source/src/task.c:315 start_task at /source/src/task.c:1215 unknown function (ip: (nil)) ============================================================== Profile collected. A report will print at the next yield point ============================================================== PkgEval terminated after 2721.12s: test duration exceeded the time limit