Package evaluation of ReTestItems on Julia 1.13.0-DEV.873 (be59b3b2f4*) started at 2025-07-17T17:11:17.360 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 11.11s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Installed ReTestItems ─ v1.32.0 Updating `~/.julia/environments/v1.13/Project.toml` [817f1d60] + ReTestItems v1.32.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [817f1d60] + ReTestItems v1.32.0 [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.65.0+0 [3f19e933] + p7zip_jll v17.5.0+2 Installation completed after 1.03s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 4971.4 ms ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 26 already precompiled. Precompiling package dependencies... Precompilation completed after 45.84s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_Bu0dgl/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.32.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.13.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_Bu0dgl/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.1 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.0 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.32.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 ⌅ [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Worker 100: [100] signal 15: Terminated Worker 105: [105] signal 15: Terminated CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:110 Expression: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 120: ======================================================================================\n Worker 120: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 120: ======================================================================================\n Worker 120: cmd: /opt/julia/bin/julia 120 running 3 of 7\n Worker 120: signal (10): User defined signal 1\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752906dc68) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x76752906f08d) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 120: _ZN4llvm6MDNodenwEmmNS_8Metadata11StorageTypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm12DISubprogram7getImplERNS_11LLVMContextEPNS_8MetadataEPNS_8MDStringES6_S4_jS4_jS4_jiNS_6DINode7DIFlagsENS0_9DISPFlagsES4_S4_S4_S4_S4_S4_S6_NS3_11StorageTypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm9DIBuilder14createFunctionEPNS_7DIScopeENS_9StringRefES3_PNS_6DIFileEjPNS_16DISubroutineTypeEjNS_6DINode7DIFlagsENS_12DISubprogram9DISPFlagsENS_24MDTupleTypedArrayWrapperINS_19DITemplateParameterEEEPSA_NSC_INS_6DITypeEEENSC_IS8_EES3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: operator() at /source/src/codegen.cpp:8977\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:8942\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:9006 [inlined]\n Worker 120: emit_function at /source/src/codegen.cpp:9186\n Worker 120: jl_emit_code at /source/src/codegen.cpp:9795\n Worker 120: jl_emit_codeinst at /source/src/codegen.cpp:9866\n Worker 120: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:820\n Worker 120: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined]\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 120: jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: jl_type_infer at /source/src/gf.c:462\n Worker 120: jl_compile_method_internal at /source/src/gf.c:3306\n Worker 120: _jl_invoke at /source/src/gf.c:3799 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 120: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: ==============================================================\n Worker 120: Profile collected. A report will print at the next yield point\n Worker 120: ==============================================================\n Worker 120: ┌ Warning: There were no samples collected in one or more groups.\n Worker 120: │ This may be due to idle threads, or you may need to run your\n Worker 120: │ program longer (perhaps by running it multiple times),\n Worker 120: │ or adjust the delay between samples with `Profile.init()`.\n Worker 120: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 120: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 120: =========================================================\n Worker 120: Thread 1 (interactive) Task 0x00007675119873a0 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 2 (interactive) Task 0x0000767512dfc100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 3 (default) Task 0x0000767511ab3760 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 4 (default) Task 0x0000767512df4100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 5 (default) Task 0x0000767512df0100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 6 (foreign: gc) Task 0x0000767512dec010 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 7 (foreign: gc) Task 0x0000767512de8010 Total snapshots: 26. Utilization: 100%\n Worker 120: [120] signal 15: Terminated\n\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:110 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:111 Expression: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 120: ======================================================================================\n Worker 120: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 120: ======================================================================================\n Worker 120: cmd: /opt/julia/bin/julia 120 running 3 of 7\n Worker 120: signal (10): User defined signal 1\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752906dc68) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x76752906f08d) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 120: _ZN4llvm6MDNodenwEmmNS_8Metadata11StorageTypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm12DISubprogram7getImplERNS_11LLVMContextEPNS_8MetadataEPNS_8MDStringES6_S4_jS4_jS4_jiNS_6DINode7DIFlagsENS0_9DISPFlagsES4_S4_S4_S4_S4_S4_S6_NS3_11StorageTypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm9DIBuilder14createFunctionEPNS_7DIScopeENS_9StringRefES3_PNS_6DIFileEjPNS_16DISubroutineTypeEjNS_6DINode7DIFlagsENS_12DISubprogram9DISPFlagsENS_24MDTupleTypedArrayWrapperINS_19DITemplateParameterEEEPSA_NSC_INS_6DITypeEEENSC_IS8_EES3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: operator() at /source/src/codegen.cpp:8977\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:8942\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:9006 [inlined]\n Worker 120: emit_function at /source/src/codegen.cpp:9186\n Worker 120: jl_emit_code at /source/src/codegen.cpp:9795\n Worker 120: jl_emit_codeinst at /source/src/codegen.cpp:9866\n Worker 120: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:820\n Worker 120: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined]\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 120: jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: jl_type_infer at /source/src/gf.c:462\n Worker 120: jl_compile_method_internal at /source/src/gf.c:3306\n Worker 120: _jl_invoke at /source/src/gf.c:3799 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 120: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: ==============================================================\n Worker 120: Profile collected. A report will print at the next yield point\n Worker 120: ==============================================================\n Worker 120: ┌ Warning: There were no samples collected in one or more groups.\n Worker 120: │ This may be due to idle threads, or you may need to run your\n Worker 120: │ program longer (perhaps by running it multiple times),\n Worker 120: │ or adjust the delay between samples with `Profile.init()`.\n Worker 120: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 120: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 120: =========================================================\n Worker 120: Thread 1 (interactive) Task 0x00007675119873a0 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 2 (interactive) Task 0x0000767512dfc100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 3 (default) Task 0x0000767511ab3760 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 4 (default) Task 0x0000767512df4100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 5 (default) Task 0x0000767512df0100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 6 (foreign: gc) Task 0x0000767512dec010 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 7 (foreign: gc) Task 0x0000767512de8010 Total snapshots: 26. Utilization: 100%\n Worker 120: [120] signal 15: Terminated\n\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:111 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:112 Expression: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 120: ======================================================================================\n Worker 120: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 120: ======================================================================================\n Worker 120: cmd: /opt/julia/bin/julia 120 running 3 of 7\n Worker 120: signal (10): User defined signal 1\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752906dc68) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x76752906f08d) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 120: _ZN4llvm6MDNodenwEmmNS_8Metadata11StorageTypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm12DISubprogram7getImplERNS_11LLVMContextEPNS_8MetadataEPNS_8MDStringES6_S4_jS4_jS4_jiNS_6DINode7DIFlagsENS0_9DISPFlagsES4_S4_S4_S4_S4_S4_S6_NS3_11StorageTypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm9DIBuilder14createFunctionEPNS_7DIScopeENS_9StringRefES3_PNS_6DIFileEjPNS_16DISubroutineTypeEjNS_6DINode7DIFlagsENS_12DISubprogram9DISPFlagsENS_24MDTupleTypedArrayWrapperINS_19DITemplateParameterEEEPSA_NSC_INS_6DITypeEEENSC_IS8_EES3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: operator() at /source/src/codegen.cpp:8977\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:8942\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:9006 [inlined]\n Worker 120: emit_function at /source/src/codegen.cpp:9186\n Worker 120: jl_emit_code at /source/src/codegen.cpp:9795\n Worker 120: jl_emit_codeinst at /source/src/codegen.cpp:9866\n Worker 120: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:820\n Worker 120: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined]\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 120: jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: jl_type_infer at /source/src/gf.c:462\n Worker 120: jl_compile_method_internal at /source/src/gf.c:3306\n Worker 120: _jl_invoke at /source/src/gf.c:3799 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 120: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: ==============================================================\n Worker 120: Profile collected. A report will print at the next yield point\n Worker 120: ==============================================================\n Worker 120: ┌ Warning: There were no samples collected in one or more groups.\n Worker 120: │ This may be due to idle threads, or you may need to run your\n Worker 120: │ program longer (perhaps by running it multiple times),\n Worker 120: │ or adjust the delay between samples with `Profile.init()`.\n Worker 120: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 120: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 120: =========================================================\n Worker 120: Thread 1 (interactive) Task 0x00007675119873a0 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 2 (interactive) Task 0x0000767512dfc100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 3 (default) Task 0x0000767511ab3760 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 4 (default) Task 0x0000767512df4100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 5 (default) Task 0x0000767512df0100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 6 (foreign: gc) Task 0x0000767512dec010 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 7 (foreign: gc) Task 0x0000767512de8010 Total snapshots: 26. Utilization: 100%\n Worker 120: [120] signal 15: Terminated\n\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:112 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:114 Expression: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 120: ======================================================================================\n Worker 120: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 120: ======================================================================================\n Worker 120: cmd: /opt/julia/bin/julia 120 running 3 of 7\n Worker 120: signal (10): User defined signal 1\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752906dc68) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x76752906f08d) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 120: _ZN4llvm6MDNodenwEmmNS_8Metadata11StorageTypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm12DISubprogram7getImplERNS_11LLVMContextEPNS_8MetadataEPNS_8MDStringES6_S4_jS4_jS4_jiNS_6DINode7DIFlagsENS0_9DISPFlagsES4_S4_S4_S4_S4_S4_S6_NS3_11StorageTypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm9DIBuilder14createFunctionEPNS_7DIScopeENS_9StringRefES3_PNS_6DIFileEjPNS_16DISubroutineTypeEjNS_6DINode7DIFlagsENS_12DISubprogram9DISPFlagsENS_24MDTupleTypedArrayWrapperINS_19DITemplateParameterEEEPSA_NSC_INS_6DITypeEEENSC_IS8_EES3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: operator() at /source/src/codegen.cpp:8977\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:8942\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:9006 [inlined]\n Worker 120: emit_function at /source/src/codegen.cpp:9186\n Worker 120: jl_emit_code at /source/src/codegen.cpp:9795\n Worker 120: jl_emit_codeinst at /source/src/codegen.cpp:9866\n Worker 120: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:820\n Worker 120: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined]\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 120: jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: jl_type_infer at /source/src/gf.c:462\n Worker 120: jl_compile_method_internal at /source/src/gf.c:3306\n Worker 120: _jl_invoke at /source/src/gf.c:3799 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 120: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: ==============================================================\n Worker 120: Profile collected. A report will print at the next yield point\n Worker 120: ==============================================================\n Worker 120: ┌ Warning: There were no samples collected in one or more groups.\n Worker 120: │ This may be due to idle threads, or you may need to run your\n Worker 120: │ program longer (perhaps by running it multiple times),\n Worker 120: │ or adjust the delay between samples with `Profile.init()`.\n Worker 120: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 120: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 120: =========================================================\n Worker 120: Thread 1 (interactive) Task 0x00007675119873a0 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 2 (interactive) Task 0x0000767512dfc100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 3 (default) Task 0x0000767511ab3760 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 4 (default) Task 0x0000767512df4100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 5 (default) Task 0x0000767512df0100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 6 (foreign: gc) Task 0x0000767512dec010 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 7 (foreign: gc) Task 0x0000767512de8010 Total snapshots: 26. Utilization: 100%\n Worker 120: [120] signal 15: Terminated\n\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:114 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:115 Expression: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 120: ======================================================================================\n Worker 120: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 120: ======================================================================================\n Worker 120: cmd: /opt/julia/bin/julia 120 running 3 of 7\n Worker 120: signal (10): User defined signal 1\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 120: unknown function (ip: 0x7675290601c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x7675290e085b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752906dc68) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: unknown function (ip: 0x76752906f08d) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 120: _ZN4llvm6MDNodenwEmmNS_8Metadata11StorageTypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm12DISubprogram7getImplERNS_11LLVMContextEPNS_8MetadataEPNS_8MDStringES6_S4_jS4_jS4_jiNS_6DINode7DIFlagsENS0_9DISPFlagsES4_S4_S4_S4_S4_S4_S6_NS3_11StorageTypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: _ZN4llvm9DIBuilder14createFunctionEPNS_7DIScopeENS_9StringRefES3_PNS_6DIFileEjPNS_16DISubroutineTypeEjNS_6DINode7DIFlagsENS_12DISubprogram9DISPFlagsENS_24MDTupleTypedArrayWrapperINS_19DITemplateParameterEEEPSA_NSC_INS_6DITypeEEENSC_IS8_EES3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 120: operator() at /source/src/codegen.cpp:8977\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:8942\n Worker 120: operator() at /usr/local/x86_64-linux-gnu/include/c++/9.1.0/bits/std_function.h:690 [inlined]\n Worker 120: operator() at /source/src/codegen.cpp:9006 [inlined]\n Worker 120: emit_function at /source/src/codegen.cpp:9186\n Worker 120: jl_emit_code at /source/src/codegen.cpp:9795\n Worker 120: jl_emit_codeinst at /source/src/codegen.cpp:9866\n Worker 120: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:820\n Worker 120: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined]\n Worker 120: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 120: jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: jl_type_infer at /source/src/gf.c:462\n Worker 120: jl_compile_method_internal at /source/src/gf.c:3306\n Worker 120: _jl_invoke at /source/src/gf.c:3799 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: unknown function (ip: 0x76752905cf14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 120: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 120: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 120: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 120: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 120: wait at ./task.jl:1192\n Worker 120: wait_forever at ./task.jl:1129\n Worker 120: jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 120: _jl_invoke at /source/src/gf.c:3807 [inlined]\n Worker 120: ijl_apply_generic at /source/src/gf.c:4004\n Worker 120: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 120: start_task at /source/src/task.c:1249\n Worker 120: unknown function (ip: (nil)) at (unknown file)\n Worker 120: ==============================================================\n Worker 120: Profile collected. A report will print at the next yield point\n Worker 120: ==============================================================\n Worker 120: ┌ Warning: There were no samples collected in one or more groups.\n Worker 120: │ This may be due to idle threads, or you may need to run your\n Worker 120: │ program longer (perhaps by running it multiple times),\n Worker 120: │ or adjust the delay between samples with `Profile.init()`.\n Worker 120: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 120: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 120: =========================================================\n Worker 120: Thread 1 (interactive) Task 0x00007675119873a0 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 2 (interactive) Task 0x0000767512dfc100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 3 (default) Task 0x0000767511ab3760 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 4 (default) Task 0x0000767512df4100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 5 (default) Task 0x0000767512df0100 Total snapshots: 26. Utilization: 0%\n Worker 120: ╎26 @Base/task.jl:1129 wait_forever()\n Worker 120: 25╎ 26 @Base/task.jl:1192 wait()\n Worker 120: Thread 6 (foreign: gc) Task 0x0000767512dec010 Total snapshots: 26. Utilization: 100%\n Worker 120: Thread 7 (foreign: gc) Task 0x0000767512de8010 Total snapshots: 26. Utilization: 100%\n Worker 120: [120] signal 15: Terminated\n\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:115 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] only requested testfiles included: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:90 Got exception outside of a @test IOError: readdir("/this/file"): no such file or directory (ENOENT) Stacktrace: [1] iterate(c::Channel{Tuple{String, Vector{String}, Vector{String}}}, state::Nothing) @ Base ./channels.jl:724 [2] iterate @ ./channels.jl:707 [inlined] [3] macro expansion @ ./task.jl:633 [inlined] [4] include_testfiles!(project_name::String, projectfile::String, paths::Tuple{String}, ti_filter::TestItemFilter{Returns{Bool}, Nothing, Nothing}, verbose_results::Bool, report::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:789 [5] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:90 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:91 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:97 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] IncludeInto @ ./Base.jl:311 [inlined] [14] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:19 [15] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [16] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:489 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [23] _start() @ Base ./client.jl:553 ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:132 17:13:53 | maxrss 1.6% | mem 1.9% | SKIP (0/1) test item "skip" at internals.jl:288 should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:311 Test threw exception Expression: should_skip(ti) UndefVarError: `##skip#293` not defined in `Main.var"##skip_x#292"` The binding may be too new: running in world age 39008, while current world is 39010. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:311 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:313 Test threw exception Expression: !(should_skip(ti)) UndefVarError: `##skip#295` not defined in `Main.var"##skip_x#294"` The binding may be too new: running in world age 39010, while current world is 39012. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:316 Test threw exception Expression: should_skip(ti) UndefVarError: `##skip#297` not defined in `Main.var"##skip_x#296"` The binding may be too new: running in world age 39012, while current world is 39015. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:316 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:318 Test threw exception Expression: !(should_skip(ti)) UndefVarError: `##skip#299` not defined in `Main.var"##skip_x#298"` The binding may be too new: running in world age 39015, while current world is 39018. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:318 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:321 Expression: should_skip(ti) Expected: "Test item \"x\" `skip` keyword must be a `Bool`, got `skip=2`" Message: "UndefVarError: `##skip#301` not defined in `Main.var\"##skip_x#300\"`\nThe binding may be too new: running in world age 39018, while current world is 39021." Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:321 [inlined] 17:14:00 | maxrss 1.7% | mem 1.9% | START test item "TI1" at macros.jl:32 17:14:00 | maxrss 1.7% | mem 1.9% | DONE test item "TI1" 0.2 secs (97.9% compile), 106.39 K allocs (6.587 MB) 17:14:00 | maxrss 1.7% | mem 1.9% | START test item "TI2" at macros.jl:43 17:14:00 | maxrss 1.7% | mem 1.9% | DONE test item "TI2" <0.1 secs (<0.1% compile), 993 allocs (55.552 KB) 17:14:00 | maxrss 1.7% | mem 1.9% | START test item "TI" at macros.jl:53 17:14:00 | maxrss 1.7% | mem 1.9% | DONE test item "TI" <0.1 secs (<0.1% compile), 993 allocs (55.584 KB) 17:14:00 | maxrss 1.7% | mem 1.9% | START test item "macro-import" at macros.jl:64 17:14:02 | maxrss 1.7% | mem 1.9% | DONE test item "macro-import" 1.4 secs (99.1% compile, 4.2% GC), 536.41 K allocs (31.254 MB) 17:14:02 | maxrss 1.7% | mem 1.9% | START test item "Foo" at macros.jl:95 17:14:02 | maxrss 1.7% | mem 1.9% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.38 K allocs (106.832 KB) 17:14:03 | maxrss 1.7% | mem 1.9% | START test item "Foo3" at macros.jl:110 17:14:03 | maxrss 1.7% | mem 1.9% | DONE test item "Foo3" <0.1 secs (<0.1% compile), 1.98 K allocs (93.296 KB) 17:14:03 | maxrss 1.7% | mem 1.9% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:109 [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [10] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [11] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [12] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1018 [13] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:23 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:118 [inlined] [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [17] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:123 [inlined] [18] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [19] IncludeInto @ ./Base.jl:311 [inlined] [20] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:20 [21] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [22] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ none:6 [27] eval(m::Module, e::Any) @ Core ./boot.jl:489 [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [29] _start() @ Base ./client.jl:553 17:14:03 | maxrss 1.7% | mem 1.9% | DONE test item "Foo4" 17:14:03 | maxrss 1.7% | mem 1.9% | START test item "testitem active" at macros.jl:138 17:14:03 | maxrss 1.7% | mem 1.9% | DONE test item "testitem active" <0.1 secs (80.2% compile), 2.82 K allocs (151.456 KB) 17:14:03 | maxrss 1.7% | mem 1.9% | START test item "run" at macros.jl:146 17:14:03 | maxrss 1.7% | mem 1.9% | DONE test item "run" <0.1 secs (<0.1% compile), 992 allocs (57.024 KB) 17:14:04 | maxrss 1.7% | mem 1.9% | START test item "comparisons" at macros.jl:182 17:14:05 | maxrss 1.7% | mem 1.9% | DONE test item "comparisons" <0.1 secs (77.0% compile), 14.10 K allocs (897.616 KB) 17:14:07 | maxrss 1.7% | mem 2.0% | SKIP test item "skip isa bool" at macros.jl:306 17:14:08 | maxrss 1.7% | mem 2.0% | SKIP test item "test contains error" at macros.jl:314 testitem `skip` keyword: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:295 Got exception outside of a @test UndefVarError: `##skip#363` not defined in `Main.var"##skip_skip isa expr 1#362"` The binding may be too new: running in world age 39173, while current world is 39175. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1031 [3] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [4] runtestitem(ti::TestItem; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1018 [5] runtestitem(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1010 [6] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:23 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:296 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:341 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] IncludeInto @ ./Base.jl:311 [inlined] [13] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:20 [14] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [15] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [17] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [18] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [19] top-level scope @ none:6 [20] eval(m::Module, e::Any) @ Core ./boot.jl:489 [21] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [22] _start() @ Base ./client.jl:553 17:14:08 | maxrss 1.7% | mem 2.0% | START test item "default_imports" at macros.jl:424 17:14:08 | maxrss 1.7% | mem 2.0% | DONE test item "default_imports" <0.1 secs (<0.1% compile), 1.48 K allocs (73.408 KB) 17:14:08 | maxrss 1.7% | mem 2.0% | START test item "no_default_imports" at macros.jl:432 17:14:08 | maxrss 1.7% | mem 2.0% | DONE test item "no_default_imports" 0.2 secs (99.3% compile), 398.10 K allocs (24.238 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/RVvCj` Updating `~/.julia/packages/ReTestItems/RVvCj/Project.toml` [1e6cf692] + TestEnv v1.102.1 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.13.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/RVvCj/Manifest.toml` [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] ~ Pkg ⇒ v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.65.0+0 [3f19e933] + p7zip_jll v17.5.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:42 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 17:14:42 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.33 K allocs (74.608 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:42 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 17:14:42 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.24 K allocs (67.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nested [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:42 | maxrss 2.0% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 17:14:42 | maxrss 2.0% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.24 K allocs (67.424 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` 17:14:45 | maxrss 2.0% | mem 2.2% | START (1/1) test item "foo" at src/foo_test.jl:1 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "foo" 0.9 secs (1.9% compile), 49.72 K allocs (6.986 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 91 17:14:46 | maxrss 2.0% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (129.416 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.600 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.632 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:14:46 | maxrss 2.0% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) 17:14:46 | maxrss 2.0% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:14:47 | maxrss 2.0% | mem 2.2% | DONE (7/8) test item "bar" 0.6 secs (97.6% compile), 297.93 K allocs (16.594 MB) 17:14:47 | maxrss 2.0% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 17:14:47 | maxrss 2.0% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.02 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.01 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:50 | maxrss 2.0% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:14:50 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.98 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.07 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:53 | maxrss 2.0% | mem 2.2% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 17:14:53 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scheduling 1 tests on pid 91 17:14:55 | maxrss 2.0% | mem 2.2% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 17:14:55 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.11 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.03 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl filter `runtests(func, x)`: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 Expression: runtests((ti->begin #= /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 =# contains(ti.file, "bar_") end), pkg) Expected: "no field file" Message: "TaskFailedException\n\n nested task error: LoadError: FieldError: type ReTestItems.TestItemMetadata has no field `file`, available fields: `name`, `tags`\n Stacktrace:\n [1] getproperty\n @ ./Base_compiler.jl:57 [inlined]\n [2] (::var\"#327#328\")(ti::ReTestItems.TestItemMetadata)\n @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212\n [3] (::TestItemFilter{var\"#327#328\", Nothing, Nothing})(ti::ReTestItems.TestItemMetadata)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:19\n [4] filter_testitem(f::TestItemFilter{var\"#327#328\", Nothing, Nothing}, expr::Expr)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:62\n [5] TestItemFilter\n @ ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:37 [inlined]\n [6] include_string(mapexpr::TestItemFilter{var\"#327#328\", Nothing, Nothing}, mod::Module, code::String, filename::String)\n @ Base ./loading.jl:2844\n [7] _include(mapexpr::Function, mod::Module, _path::String)\n @ Base ./loading.jl:2908\n [8] include(mapexpr::Function, mod::Module, _path::String)\n @ Base ./Base.jl:310\n [9] #include_testfiles!##10\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:825 [inlined]\n [10] task_local_storage(body::ReTestItems.var\"#include_testfiles!##10#include_testfiles!##11\"{TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Channel{Pair{Symbol, TestSetup}})\n @ Base ./task.jl:298\n [11] #include_testfiles!##8\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:824 [inlined]\n [12] task_local_storage(body::ReTestItems.var\"#include_testfiles!##8#include_testfiles!##9\"{Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::String)\n @ Base ./task.jl:298\n [13] #include_testfiles!##6\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:823 [inlined]\n [14] task_local_storage(body::ReTestItems.var\"#include_testfiles!##6#include_testfiles!##7\"{String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Tuple{ReTestItems.FileNode, Set{String}})\n @ Base ./task.jl:298\n [15] #include_testfiles!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:822 [inlined]\n [16] task_local_storage(body::ReTestItems.var\"#include_testfiles!##4#include_testfiles!##5\"{ReTestItems.FileNode, Set{String}, String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Bool)\n @ Base ./task.jl:298\n [17] (::ReTestItems.var\"#include_testfiles!##2#include_testfiles!##3\"{ReTestItems.FileNode, Set{String}, String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String})()\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:821\n in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/bar_tests.jl:1\n\n...and 5 more exceptions.\n" Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:136 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 91 17:15:00 | maxrss 2.0% | mem 2.2% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 17:15:00 | maxrss 2.0% | mem 2.2% | DONE (1/5) test item "scope test - loops" <0.1 secs (<0.1% compile), 1.42 K allocs (75.264 KB) 17:15:00 | maxrss 2.0% | mem 2.2% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 17:15:00 | maxrss 2.0% | mem 2.2% | DONE (2/5) test item "scope test - setups" <0.1 secs (<0.1% compile), 1.56 K allocs (81.504 KB) 17:15:00 | maxrss 2.0% | mem 2.2% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 17:15:00 | maxrss 2.0% | mem 2.2% | DONE (3/5) test item "scope test - testsets" <0.1 secs (<0.1% compile), 2.79 K allocs (127.704 KB) 17:15:00 | maxrss 2.0% | mem 2.2% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 17:15:00 | maxrss 2.0% | mem 2.2% | DONE (4/5) test item "scope test - imports" <0.1 secs (58.5% compile), 6.47 K allocs (306.296 KB) 17:15:00 | maxrss 2.0% | mem 2.2% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 17:15:00 | maxrss 2.0% | mem 2.2% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.61 K allocs (119.448 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/Manifest.toml:0 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Testing NoDeps Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Updating `/tmp/jl_QybSDx/Project.toml` [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_QybSDx/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_QybSDx/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] Test v1.11.0 Status `/tmp/jl_QybSDx/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.36 seconds. [ Info: Scheduling 2 tests on pid 144 17:15:27 | maxrss 2.0% | mem 3.2% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 17:15:27 | maxrss 2.0% | mem 3.2% | DONE (1/2) test item "toplevel" 0.2 secs (96.7% compile), 15.18 K allocs (802.016 KB) 17:15:28 | maxrss 2.0% | mem 3.2% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 17:15:28 | maxrss 2.0% | mem 3.3% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.9% compile), 33.01 K allocs (1.861 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 144 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.6s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.0s Testing NoDeps tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Testing TestsInSrc Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Updating `/tmp/jl_pTyPbF/Project.toml` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_pTyPbF/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_pTyPbF/Project.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_pTyPbF/Manifest.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.42 seconds. [ Info: Scheduling 8 tests on pid 148 17:15:50 | maxrss 2.0% | mem 3.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:15:50 | maxrss 2.0% | mem 3.3% | DONE (1/8) test item "a1" 0.2 secs (96.7% compile), 15.87 K allocs (852.664 KB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:15:51 | maxrss 2.0% | mem 3.3% | DONE (2/8) test item "a2" 0.2 secs (93.8% compile), 32.98 K allocs (1.857 MB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:15:51 | maxrss 2.0% | mem 3.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.03 K allocs (57.568 KB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:15:51 | maxrss 2.0% | mem 3.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.03 K allocs (57.600 KB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:15:51 | maxrss 2.0% | mem 3.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.03 K allocs (57.664 KB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:15:51 | maxrss 2.0% | mem 3.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.03 K allocs (57.392 KB) 17:15:51 | maxrss 2.0% | mem 3.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:15:52 | maxrss 2.0% | mem 3.3% | DONE (7/8) test item "bar" 1.0 secs (98.5% compile, 12.4% GC), 510.03 K allocs (28.544 MB) 17:15:52 | maxrss 2.0% | mem 3.3% | START (8/8) test item "foo" at src/foo_test.jl:1 17:15:52 | maxrss 2.0% | mem 3.3% | DONE (8/8) test item "foo" <0.1 secs (74.5% compile), 3.27 K allocs (165.360 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.7s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.0s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 1.0s bar values | 2 2 0.3s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Installed Example ─ v0.5.3 Testing TestProjectFile Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Installed Parsers ───────── v2.8.3 Installed Example ───────── v0.5.5 Installed PrecompileTools ─ v1.3.2 Installed InlineStrings ─── v1.0.0 Updating `/tmp/jl_fS690u/Project.toml` [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_fS690u/Manifest.toml` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [69de0a69] ↑ Parsers v2.5.8 ⇒ v2.8.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] ↑ Preferences v1.3.0 ⇒ v1.4.3 [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [66db9d55] - SnoopPrecompile v1.0.3 [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_fS690u/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_fS690u/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 864.7 ms ✓ Example 746.9 ms ✓ TestProjectFile 2 dependencies successfully precompiled in 2 seconds [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.36 seconds. [ Info: Scheduling 1 tests on pid 157 17:16:17 | maxrss 2.0% | mem 3.3% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 17:16:39 | maxrss 2.0% | mem 3.3% | DONE (1/1) test item "TestProjectFile" 21.8 secs (6.1% compile, 2.3% recompile, 0.6% GC), 858.59 K allocs (51.689 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 157 Precompiling packages... 1017.1 ms ✓ PrecompileTools 17795.2 ms ✓ Parsers 1298.6 ms ✓ InlineStrings 3 dependencies successfully precompiled in 20 seconds. 6 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 25.0s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 21.8s test-only dep on InlineStrings | 1 1 21.4s Testing TestProjectFile tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Installed TestEnv ─────── v1.100.1 Installed LoggingExtras ─ v1.0.1 Testing TestEndExpr Status `/tmp/jl_llikxt/Project.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_llikxt/Manifest.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [loaded: v1.102.1] [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling packages... 5159.6 ms ✓ TestEnv 6918.9 ms ✓ ReTestItems 2 dependencies successfully precompiled in 12 seconds. 29 already precompiled. Precompiling packages... 869.5 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.56 seconds. [ Info: Scheduling 2 tests on pid 187 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 203: [ Info: Starting test worker 1 on pid = 203, with 2 threads [ Info: Starting running test items Worker 203: 17:17:38 | maxrss 1.7% | mem 4.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 203: 17:17:38 | maxrss 1.7% | mem 4.0% | DONE (1/2) test item "correct usage" 0.3 secs (97.8% compile), 65.38 K allocs (3.670 MB) Worker 203: 17:17:39 | maxrss 1.7% | mem 4.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 203: 17:17:40 | maxrss 1.7% | mem 4.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (79.3% compile), 2.34 K allocs (125.552 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=203). Worker 203: [203] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 27.6s Testing TestEndExpr tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Testing DontPass Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Updating `/tmp/jl_LOWU3M/Project.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_LOWU3M/Manifest.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.7.15 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_LOWU3M/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [37e2e46d] LinearAlgebra v1.12.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_LOWU3M/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... Precompiling packages... 862.9 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.38 seconds. [ Info: Scheduling 9 tests on pid 212 17:18:06 | maxrss 2.0% | mem 3.3% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:18:07 | maxrss 2.0% | mem 3.3% | DONE (1/9) test item "do_thing Pass" 0.7 secs (99.1% compile), 187.03 K allocs (10.115 MB) 17:18:07 | maxrss 2.0% | mem 3.3% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:18:07 | maxrss 2.0% | mem 3.3% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.3% compile), 107.66 K allocs (6.317 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 212 Error in testset "do_thing Fail" on worker 212: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.08484435223583564, 0.3466367887226164, 0.7696766450519811] == 1 17:18:08 | maxrss 2.0% | mem 3.3% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:18:13 | maxrss 2.0% | mem 3.4% | DONE (3/9) test item "do_thing Error" 4.6 secs (92.5% compile, 2.8% recompile, 3.1% GC), 3.48 M allocs (214.852 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 212 Error in testset "do_thing Error" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 17:18:13 | maxrss 2.0% | mem 3.4% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:18:13 | maxrss 2.0% | mem 3.4% | DONE (4/9) test item "bad setup, good test" 0.5 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 212 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 212 Error in testset "bad setup, good test" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [29] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [30] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 17:18:13 | maxrss 2.0% | mem 3.4% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:18:13 | maxrss 2.0% | mem 3.4% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 212 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 212 Error in testset "bad setup, bad test" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [29] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [30] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 17:18:13 | maxrss 2.0% | mem 3.4% | START (6/9) test item "errors" at test/error_tests.jl:1 17:18:15 | maxrss 2.0% | mem 3.4% | DONE (6/9) test item "errors" 1.5 secs (96.6% compile), 470.03 K allocs (27.862 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 212 Error in testset "UndefVarError" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#299"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#299"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [32] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [33] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [34] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [35] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [36] top-level scope @ none:6 [37] eval(m::Module, e::Any) @ Core ./boot.jl:489 [38] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [39] _start() @ Base ./client.jl:553 17:18:15 | maxrss 2.0% | mem 3.4% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 17:18:15 | maxrss 2.0% | mem 3.4% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 212 Error in testset "errors at the top level" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [24] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [30] _start() @ Base ./client.jl:553 17:18:15 | maxrss 2.0% | mem 3.4% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:18:15 | maxrss 2.0% | mem 3.4% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 212 Error in testset "nonexistent test setup" on worker 212: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [25] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [26] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [27] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [29] top-level scope @ none:6 [30] eval(m::Module, e::Any) @ Core ./boot.jl:489 [31] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [32] _start() @ Base ./client.jl:553 17:18:15 | maxrss 2.0% | mem 3.4% | START (9/9) test item "failures" at test/failure_tests.jl:1 17:18:15 | maxrss 2.0% | mem 3.4% | DONE (9/9) test item "failures" <0.1 secs (74.1% compile), 4.79 K allocs (240.752 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 212 Error in testset "failures" on worker 212: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 212: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.08547238639512553 < 0 Error in testset "failures" on worker 212: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 12.8s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.7s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 4.6s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.5s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 1.6s UndefVarError | 2 2 1.2s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.1s errors at the top level | 1 1 2 0.2s nonexistent test setup | 1 1 0.1s test/failure_tests.jl | 3 3 failures | 3 3 0.0s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 91 17:18:17 | maxrss 2.1% | mem 2.2% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.08 K allocs (61.632 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.63 K allocs (122.400 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 91 17:18:17 | maxrss 2.1% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.320 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.760 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.872 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 17:18:17 | maxrss 2.1% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 17:18:17 | maxrss 2.1% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (84.528 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 runtests() TestProjectFile.jl: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:250 Expression: n_passed(results) > 0 Evaluated: 0 > 0 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:250 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] runtests() TestProjectFile.jl: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:251 Expression: all_passed(results) Evaluated: all_passed(Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:53 Got exception outside of a @test MethodError: no method matching prune_manifest(::Pkg.Types.Manifest, ::Vector{Base.UUID}) The function `prune_manifest` exists, but no method is defined for this combination of argument types. Closest candidates are: prune_manifest(::Pkg.Types.Manifest, !Matched::Set{Base.UUID}) @ Pkg /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:1343 prune_manifest(!Matched::Pkg.Types.EnvCache) @ Pkg /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:1322 Stacktrace: [1] activate(pkg::String; allow_reresolve::Bool) @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:40 [2] activate (repeats 2 times) @ ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:9 [inlined] [3] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:362 [4] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [5] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [6] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [7] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [8] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [9] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [10] #335 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:248 [inlined] [11] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [12] activate(f::var"#with_test_package##4#with_test_package##5"{var"#335#336"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [13] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [14] cd(f::var"#with_test_package##2#with_test_package##3"{var"#335#336"}, dir::String) @ Base.Filesystem ./file.jl:112 [15] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#335#336", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [19] with_test_package(f::var"#335#336", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [20] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [24] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [25] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [26] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:247 [inlined] [27] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [28] IncludeInto @ ./Base.jl:311 [inlined] [29] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [30] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [31] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [34] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [35] top-level scope @ none:6 [36] eval(m::Module, e::Any) @ Core ./boot.jl:489 [37] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [38] _start() @ Base ./client.jl:553) Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:251 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 91 17:18:20 | maxrss 2.1% | mem 2.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:18:20 | maxrss 2.1% | mem 2.2% | DONE (1/9) test item "do_thing Pass" <0.1 secs (75.0% compile), 12.89 K allocs (708.488 KB) 17:18:20 | maxrss 2.1% | mem 2.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:18:21 | maxrss 2.1% | mem 2.2% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.5% compile), 107.68 K allocs (6.316 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 91 Error in testset "do_thing Fail" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.9991146544710365, 0.2589386718891218, 0.696245854681901] == 1 17:18:21 | maxrss 2.1% | mem 2.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:18:21 | maxrss 2.1% | mem 2.2% | DONE (3/9) test item "do_thing Error" 0.4 secs (64.3% compile), 135.25 K allocs (12.264 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 91 Error in testset "do_thing Error" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 17:18:21 | maxrss 2.1% | mem 2.2% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:18:21 | maxrss 2.1% | mem 2.2% | DONE (4/9) test item "bad setup, good test" 0.2 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 91 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 91 Error in testset "bad setup, good test" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [29] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [30] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [31] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [32] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [33] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [34] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [37] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [38] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [39] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [46] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [47] IncludeInto @ ./Base.jl:311 [inlined] [48] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [49] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [50] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [51] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [52] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [53] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [54] top-level scope @ none:6 [55] eval(m::Module, e::Any) @ Core ./boot.jl:489 [56] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:18:21 | maxrss 2.1% | mem 2.2% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:18:21 | maxrss 2.1% | mem 2.2% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 91 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 91 Error in testset "bad setup, bad test" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [29] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [30] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [31] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [32] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [33] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [34] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [37] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [38] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [39] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [46] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [47] IncludeInto @ ./Base.jl:311 [inlined] [48] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [49] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [50] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [51] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [52] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [53] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [54] top-level scope @ none:6 [55] eval(m::Module, e::Any) @ Core ./boot.jl:489 [56] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:18:21 | maxrss 2.1% | mem 2.2% | START (6/9) test item "errors" at test/error_tests.jl:1 17:18:21 | maxrss 2.1% | mem 2.2% | DONE (6/9) test item "errors" 0.1 secs (55.3% compile), 45.73 K allocs (2.967 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 91 Error in testset "UndefVarError" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#491"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#491"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [32] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [33] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [34] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [36] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [41] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [43] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [45] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [51] IncludeInto @ ./Base.jl:311 [inlined] [52] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [53] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [54] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [55] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [56] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [57] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [58] top-level scope @ none:6 [59] eval(m::Module, e::Any) @ Core ./boot.jl:489 [60] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:18:21 | maxrss 2.1% | mem 2.2% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 17:18:22 | maxrss 2.1% | mem 2.2% | DONE (7/9) test item "errors at the top level" 0.1 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 91 Error in testset "errors at the top level" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [23] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [24] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [34] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [42] IncludeInto @ ./Base.jl:311 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:18:22 | maxrss 2.1% | mem 2.2% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:18:22 | maxrss 2.1% | mem 2.2% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 91 Error in testset "nonexistent test setup" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [25] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [26] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [27] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [28] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [29] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [30] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [31] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [34] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [35] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [36] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [44] IncludeInto @ ./Base.jl:311 [inlined] [45] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [46] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [49] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [51] top-level scope @ none:6 [52] eval(m::Module, e::Any) @ Core ./boot.jl:489 [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:18:22 | maxrss 2.1% | mem 2.2% | START (9/9) test item "failures" at test/failure_tests.jl:1 17:18:22 | maxrss 2.1% | mem 2.2% | DONE (9/9) test item "failures" <0.1 secs (67.2% compile), 4.85 K allocs (245.616 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 91 Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.30978988914465877 < 0 Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 91 Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:10 | maxrss 2.1% | mem 2.2% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 17:24:13 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "MonoRepo tests" 3.2 secs (<0.1% compile), 62.17 K allocs (8.557 MB) [ Tests Completed: 1/1 test items were run. ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 Testing C Test Could not use exact versions of packages in manifest, re-resolving. Note: if you do not check your manifest file into source control, then you can probably ignore this message. However, if you do check your manifest file into source control, then you probably want to pass the `allow_reresolve = false` kwarg when calling the `Pkg.test` function. Updating `/tmp/jl_J5bnrV/Project.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_J5bnrV/Manifest.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.7.15 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_J5bnrV/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] Test v1.11.0 Status `/tmp/jl_J5bnrV/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.7.15 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.45 seconds. [ Info: Scheduling 1 tests on pid 331 17:24:36 | maxrss 2.1% | mem 3.3% | START (1/1) test item "C_tests" at test/c_tests.jl:1 17:24:37 | maxrss 2.1% | mem 3.3% | DONE (1/1) test item "C_tests" 0.2 secs (95.9% compile), 29.49 K allocs (1.665 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 4.0s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.2s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:39 | maxrss 2.1% | mem 2.2% | START (1/1) test item "C_tests" at test/c_tests.jl:1 17:24:39 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "C_tests" <0.1 secs (53.2% compile), 3.86 K allocs (233.872 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:39 | maxrss 2.1% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:24:39 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.41 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:41 | maxrss 2.1% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:24:41 | maxrss 2.1% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.968 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:41 | maxrss 2.1% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:24:41 | maxrss 2.1% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 91 17:24:41 | maxrss 2.1% | mem 2.3% | START (1/2) test item "bar" at src/bar_tests.jl:1 17:24:41 | maxrss 2.1% | mem 2.3% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.456 KB) 17:24:41 | maxrss 2.1% | mem 2.3% | START (2/2) test item "foo" at src/foo_test.jl:1 17:24:41 | maxrss 2.1% | mem 2.3% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.05 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:43 | maxrss 2.1% | mem 2.3% | START (1/1) test item "bar" at src/bar_tests.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 8 tests on pid 91 17:24:43 | maxrss 2.1% | mem 2.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.728 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (62.864 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (62.112 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (8/8) test item "foo" at src/foo_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 91 17:24:43 | maxrss 2.1% | mem 2.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.728 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (62.320 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 17:24:43 | maxrss 2.1% | mem 2.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) 17:24:43 | maxrss 2.1% | mem 2.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 17:24:43 | maxrss 2.2% | mem 2.3% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 17:24:43 | maxrss 2.2% | mem 2.3% | START (8/8) test item "foo" at src/foo_test.jl:1 17:24:43 | maxrss 2.2% | mem 2.3% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:24:45 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:45 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (62.240 KB) 17:24:45 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:45 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:45 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:45 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. [ Info: Scheduling 2 tests on pid 91 17:24:47 | maxrss 2.2% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:47 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:47 | maxrss 2.2% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:47 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.2 seconds. [ Info: Scheduling 2 tests on pid 91 17:24:49 | maxrss 2.2% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:49 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:49 | maxrss 2.2% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:49 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:49 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:49 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:49 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:49 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.25 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:51 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:51 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.09 K allocs (63.848 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:24:51 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:51 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.09 K allocs (65.384 KB) 17:24:51 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:51 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.304 KB) 17:24:51 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:51 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.07 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:53 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:53 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 1 tests on pid 91 17:24:55 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:55 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:24:57 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (62.512 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:24:57 | maxrss 2.2% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:24:57 | maxrss 2.2% | mem 2.3% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:24:57 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:24:57 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:24:57 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (62.592 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.15 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.14 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scheduling 3 tests on pid 91 17:25:04 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:25:04 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:25:04 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:25:04 | maxrss 2.2% | mem 2.3% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:25:04 | maxrss 2.2% | mem 2.3% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:25:04 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:25:04 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.09 K allocs (64.296 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:25:04 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:25:04 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.768 KB) 17:25:04 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:04 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.05 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.13 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.12 seconds. [ Info: Scheduling 3 tests on pid 91 17:25:16 | maxrss 2.2% | mem 2.3% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 17:25:16 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 17:25:16 | maxrss 2.2% | mem 2.3% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 17:25:16 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 17:25:16 | maxrss 2.2% | mem 2.3% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 17:25:16 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. 17:25:16 | maxrss 2.2% | mem 2.3% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 17:25:16 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 6.76 K allocs (275.672 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:650 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 335: [ Info: Starting test worker 1 on pid = 335, with 2 threads\n[ Info: Starting running test items\n Worker 335: 17:25:33 | maxrss 2.2% | mem 3.1% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 335: 17:25:36 | maxrss 2.2% | mem 3.2% | DONE (1/2) test item \"bad setup, good test\" 2.6 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n Worker 335: 17:25:37 | maxrss 2.2% | mem 3.2% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 335: 17:25:37 | maxrss 2.2% | mem 3.2% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=335).\n Worker 335: [335] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:638 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:650 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:656 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 335: [ Info: Starting test worker 1 on pid = 335, with 2 threads\n[ Info: Starting running test items\n Worker 335: 17:25:33 | maxrss 2.2% | mem 3.1% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 335: 17:25:36 | maxrss 2.2% | mem 3.2% | DONE (1/2) test item \"bad setup, good test\" 2.6 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n Worker 335: 17:25:37 | maxrss 2.2% | mem 3.2% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 335: 17:25:37 | maxrss 2.2% | mem 3.2% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=335).\n Worker 335: [335] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:638 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:656 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 356: [ Info: Starting test worker 1 on pid = 356, with 2 threads [ Info: Starting running test items Worker 356: 17:26:19 | maxrss 2.2% | mem 3.1% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 356: 17:26:20 | maxrss 2.2% | mem 3.1% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.4% compile), 7.25 K allocs (374.640 KB) Worker 356: [356] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 356 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 356 ┌ Error: Worker(pid=356, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 363: [ Info: Starting test worker on pid = 363, with 2 threads Worker 363: 17:26:34 | maxrss 2.2% | mem 3.1% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 363: 17:26:34 | maxrss 2.2% | mem 3.1% | DONE (1/6) test item "Pass on second run" 0.2 secs (94.5% compile), 7.25 K allocs (374.640 KB) Worker 363: [363] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 363 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 363 ┌ Error: Worker(pid=363, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 370: [ Info: Starting test worker on pid = 370, with 2 threads Worker 370: 17:26:47 | maxrss 2.2% | mem 3.1% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 370: 17:26:48 | maxrss 2.2% | mem 3.1% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.4% compile), 7.25 K allocs (374.640 KB) Worker 370: [370] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 370 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 370 ┌ Error: Worker(pid=370, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 377: [ Info: Starting test worker on pid = 377, with 2 threads Worker 377: 17:27:01 | maxrss 2.2% | mem 3.1% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 377 [377] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 gc_mark_objarray at /source/src/gc-stock.c:1806 gc_mark_outrefs at /source/src/gc-stock.c:2417 [inlined] gc_mark_and_steal at /source/src/gc-stock.c:2572 gc_mark_loop_parallel at /source/src/gc-stock.c:2727 [inlined] jl_parallel_gc_threadfun at /source/src/gc-stock.c:3658 unknown function (ip: 0x784c49d5e1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x784c49dde85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x784c49d5af14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) gc_try_claim_and_push at /source/src/gc-stock.c:1688 [inlined] gc_mark_objarray at /source/src/gc-stock.c:1842 gc_mark_chunk at /source/src/gc-stock.c:2021 [inlined] gc_mark_and_steal at /source/src/gc-stock.c:2566 gc_mark_loop_parallel at /source/src/gc-stock.c:2719 gc_mark_loop at /source/src/gc-stock.c:2738 [inlined] _jl_gc_collect at /source/src/gc-stock.c:3080 ijl_gc_collect at /source/src/gc-stock.c:3489 maybe_collect at /source/src/gc-stock.c:349 [inlined] jl_gc_small_alloc_inner at /source/src/gc-stock.c:725 jl_gc_small_alloc_noinline at /source/src/gc-stock.c:783 [inlined] jl_gc_alloc_ at /source/src/gc-stock.c:797 jl_alloc_genericmemory_unchecked at /source/src/genericmemory.c:41 GenericMemory at ./boot.jl:588 [inlined] array_new_memory at ./array.jl:1069 [inlined] _growend_internal! at ./array.jl:1149 _growend! at ./array.jl:1174 [inlined] resize! at ./array.jl:1496 resize! at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:118 [inlined] DFS! at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:124 update_domtree! at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:252 [inlined] construct_domtree at ./../usr/share/julia/Compiler/src/ssair/domtree.jl:242 CFGTransformState! at ./../usr/share/julia/Compiler/src/ssair/ir.jl:736 IncrementalCompact at ./../usr/share/julia/Compiler/src/ssair/ir.jl:807 [inlined] adce_pass! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:2061 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1035 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1048 [inlined] optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1021 jfptr_optimize_85041.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:232 jfptr_finish_nocycle_85256.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4476 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3306 _jl_invoke at /source/src/gf.c:3799 [inlined] ijl_apply_generic at /source/src/gf.c:4004 show_exception_stack at ./errorshow.jl:1042 #sprint#442 at ./strings/io.jl:111 unknown function (ip: 0x784c2e33749d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 sprint at ./strings/io.jl:106 unknown function (ip: 0x784c2e33732d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f_invokelatest at /source/src/builtins.c:877 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 invokelatest at ./Base_compiler.jl:253 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 Error at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:227 do_test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:771 jfptr_do_test_4544.1 at /opt/julia/share/julia/compiled/v1.13/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_eval_module_expr at /source/src/toplevel.c:196 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:658 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 #72 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 #70 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 #redirect_stdio#653 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] #open#335 at ./io.jl:420 open at ./io.jl:417 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] #runtestitem#65 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 unknown function (ip: 0x784c2e31b4b2) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348 unknown function (ip: 0x784c2e30e88d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x784c49d5af14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_safepoint_wait_gc at /source/src/safepoint.c:268 jl_set_gc_and_wait at /source/src/safepoint.c:247 segv_handler at /source/src/signals-unix.c:413 [inlined] segv_handler at /source/src/signals-unix.c:399 unknown function (ip: 0x784c49d1104f) at /lib/x86_64-linux-gnu/libc.so.6 ijl_gc_safepoint at /source/src/jlapi.c:786 unknown function (ip: (nil)) at (unknown file) Allocations: 4439056 (Pool: 4438977; Big: 79); GC: 5 Internal error: during type inference of _atexit(Int32) Encountered unexpected error in runtime: InterruptException() ┌ Error: Worker(pid=377, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 384: [ Info: Starting test worker on pid = 384, with 2 threads Worker 384: 17:27:16 | maxrss 2.2% | mem 3.1% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 384 [384] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7da222fa7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7da222fab1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7da22302b85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7da222fa7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) finish_current_bb! at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1745 finish_current_bb! at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1747 [inlined] iterate_compact at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1952 iterate at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1871 [inlined] batch_inline! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:683 ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:79 [inlined] run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1035 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1048 [inlined] optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1021 jfptr_optimize_85041.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:232 jfptr_finish_nocycle_85256.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4476 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3306 _jl_invoke at /source/src/gf.c:3799 [inlined] ijl_apply_generic at /source/src/gf.c:4004 show_exception_stack at ./errorshow.jl:1042 #sprint#442 at ./strings/io.jl:111 unknown function (ip: 0x7da207a6968d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 sprint at ./strings/io.jl:106 unknown function (ip: 0x7da207a6951d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f_invokelatest at /source/src/builtins.c:877 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 invokelatest at ./Base_compiler.jl:253 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 Error at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:227 do_test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:771 jfptr_do_test_4544.1 at /opt/julia/share/julia/compiled/v1.13/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_eval_module_expr at /source/src/toplevel.c:196 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:658 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 #72 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 #70 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 #redirect_stdio#653 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] #open#335 at ./io.jl:420 open at ./io.jl:417 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] #runtestitem#65 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 unknown function (ip: 0x7da207a4d8e2) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348 unknown function (ip: 0x7da207a4088d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3098347 (Pool: 3098274; Big: 73); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=384, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 391: [ Info: Starting test worker on pid = 391, with 2 threads Worker 391: 17:27:30 | maxrss 2.2% | mem 3.1% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 391 [391] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7770604b5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7770604b91c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x77706053985b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7770604b5f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) lookup_type_set at /source/src/jltypes.c:1044 [inlined] lookup_type at /source/src/jltypes.c:1124 inst_datatype_inner at /source/src/jltypes.c:2138 jl_apply_tuple_type_v_ at /source/src/jltypes.c:2459 [inlined] ijl_apply_tuple_type_v at /source/src/jltypes.c:2469 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 argtypes_to_type at ./../usr/share/julia/Compiler/src/typeutils.jl:55 abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2795 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2903 abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2896 [inlined] abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3056 abstract_eval_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3074 [inlined] abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3430 abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3805 [inlined] abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3762 [inlined] typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4311 jfptr_typeinf_local_85865.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4469 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 [inlined] typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 jfptr_typeinf_ext_toplevel_85743.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3306 _jl_invoke at /source/src/gf.c:3799 [inlined] ijl_apply_generic at /source/src/gf.c:4004 show_exception_stack at ./errorshow.jl:1042 #sprint#442 at ./strings/io.jl:111 unknown function (ip: 0x777044b3768d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 sprint at ./strings/io.jl:106 unknown function (ip: 0x777044b3751d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f_invokelatest at /source/src/builtins.c:877 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 invokelatest at ./Base_compiler.jl:253 _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 Error at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:227 do_test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:771 jfptr_do_test_4544.1 at /opt/julia/share/julia/compiled/v1.13/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_eval_module_expr at /source/src/toplevel.c:196 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:658 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 #72 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 #70 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 #redirect_stdio#653 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] #open#335 at ./io.jl:420 open at ./io.jl:417 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] #runtestitem#65 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 unknown function (ip: 0x777044b1f352) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348 unknown function (ip: 0x777044b0fd9d) at (unknown file) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3098794 (Pool: 3098721; Big: 73); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=391, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 398: [ Info: Starting test worker on pid = 398, with 2 threads Worker 398: 17:27:44 | maxrss 2.2% | mem 3.1% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 398: 17:27:45 | maxrss 2.2% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.7% compile), 7.13 K allocs (369.856 KB) Worker 398: [398] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 398 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 398 ┌ Error: Worker(pid=398, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 405: [ Info: Starting test worker on pid = 405, with 2 threads Worker 405: 17:27:58 | maxrss 2.2% | mem 3.1% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 405: 17:27:59 | maxrss 2.2% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.7% compile), 7.13 K allocs (369.856 KB) Worker 405: [405] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 405 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 405 ┌ Error: Worker(pid=405, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 412: [ Info: Starting test worker on pid = 412, with 2 threads Worker 412: 17:28:13 | maxrss 2.2% | mem 3.1% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 412: 17:28:14 | maxrss 2.2% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.4% compile), 7.13 K allocs (369.856 KB) Worker 412: [412] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 412 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 412 ┌ Error: Worker(pid=412, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 419: [ Info: Starting test worker on pid = 419, with 2 threads Worker 419: 17:28:27 | maxrss 2.2% | mem 3.1% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 419: 17:28:28 | maxrss 2.2% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.6% compile), 7.13 K allocs (369.856 KB) Worker 419: [419] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x743dd9232f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 419 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 419 ┌ Error: Worker(pid=419, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 426: [ Info: Starting test worker on pid = 426, with 2 threads Worker 426: 17:28:40 | maxrss 2.2% | mem 3.1% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 426: 17:28:41 | maxrss 2.2% | mem 3.1% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.9% compile), 7.13 K allocs (369.856 KB) Worker 426: [426] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 426 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 426 ┌ Error: Worker(pid=426, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 433: [ Info: Starting test worker on pid = 433, with 2 threads Worker 433: 17:28:56 | maxrss 2.2% | mem 3.1% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 433: 17:28:56 | maxrss 2.2% | mem 3.1% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (95.5% compile), 7.13 K allocs (369.856 KB) Worker 433: [433] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 433 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 433 ┌ Error: Worker(pid=433, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 440: [ Info: Starting test worker on pid = 440, with 2 threads Worker 440: 17:29:09 | maxrss 2.2% | mem 3.1% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 440: 17:29:10 | maxrss 2.2% | mem 3.1% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (95.8% compile), 7.13 K allocs (369.856 KB) Worker 440: [440] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 440 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 440 ┌ Error: Worker(pid=440, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 447: [ Info: Starting test worker on pid = 447, with 2 threads Worker 447: 17:29:24 | maxrss 2.2% | mem 3.1% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 447: 17:29:25 | maxrss 2.2% | mem 3.1% | DONE (4/6) test item "Has retries=1 and always fails" 0.2 secs (95.8% compile), 7.13 K allocs (369.856 KB) Worker 447: [447] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 447 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 447 ┌ Error: Worker(pid=447, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 454: [ Info: Starting test worker on pid = 454, with 2 threads Worker 454: 17:29:39 | maxrss 2.2% | mem 3.1% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 454 [454] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x70079b7cff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x70079b7d31c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x70079b85385b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x70079b7cff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=454, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 461: [ Info: Starting test worker on pid = 461, with 2 threads Worker 461: 17:29:54 | maxrss 2.2% | mem 3.1% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 461 [461] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7a2c85684f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7a2c856881c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7a2c8570885b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7a2c85684f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=461, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 468: [ Info: Starting test worker on pid = 468, with 2 threads Worker 468: 17:30:10 | maxrss 2.2% | mem 3.1% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 468 [468] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x72700fb2cf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x72700fb301c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x72700fbb085b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x72700fb2cf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=468, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 475: [ Info: Starting test worker on pid = 475, with 2 threads Worker 475: 17:30:24 | maxrss 2.2% | mem 3.1% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 475 [475] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x7dc49995bf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7dc49995f1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7dc4999df85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7dc49995bf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7dc49995bf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3095329 (Pool: 3095256; Big: 73); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=475, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 482: [ Info: Starting test worker on pid = 482, with 2 threads Worker 482: 17:30:38 | maxrss 2.2% | mem 3.1% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 482: 17:30:38 | maxrss 2.2% | mem 3.1% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (96.4% compile), 139.79 K allocs (8.072 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=482). Worker 482: [482] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:716 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:716 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:718 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:718 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:721 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:721 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:724 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:724 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:734 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] DEBUG @ ReTestItems.jl:345 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` DEBUG @ ReTestItems.jl:354 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:380 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:382 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 489: [ Info: Starting test worker 1 on pid = 489, with 2 threads [ Info: Starting running test items Worker 489: 17:30:53 | maxrss 2.2% | mem 3.1% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 489 [489] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x72581eab9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x72581eabd1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x72581eb3d85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x72581eab9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x72581eab9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1192 wait_forever at ./task.jl:1129 jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3807 [inlined] ijl_apply_generic at /source/src/gf.c:4004 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3094884 (Pool: 3094811; Big: 73); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=489, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 496: [ Info: Starting test worker on pid = 496, with 2 threads Worker 496: 17:31:07 | maxrss 2.2% | mem 3.1% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 496: 17:31:07 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (96.4% compile), 20.58 K allocs (1.132 MB) Worker 496: [496] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 496 ┌ Error: Worker(pid=496, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=496, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:715 | Worker 1 closed: Worker(pid=496, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:470 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:474 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:483 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:485 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:774 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:767 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:774 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:766 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1581 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1572 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:767 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:776 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [9] IncludeInto @ ./Base.jl:311 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 DEBUG @ ReTestItems.jl:345 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` DEBUG @ ReTestItems.jl:354 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:380 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:382 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 503: [ Info: Starting test worker 1 on pid = 503, with 2 threads [ Info: Starting running test items Worker 503: 17:31:21 | maxrss 2.2% | mem 3.1% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 503 [503] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7154fd904f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7154fd9081c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7154fd98885b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7154fd904f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=503, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 510: [ Info: Starting test worker on pid = 510, with 2 threads Worker 510: 17:31:34 | maxrss 2.2% | mem 3.1% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 510: 17:31:35 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (96.2% compile), 20.58 K allocs (1.132 MB) Worker 510: [510] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 510 ┌ Error: Worker(pid=510, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=510, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:715 | Worker 1 closed: Worker(pid=510, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:470 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:474 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:483 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:485 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:796 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:787 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:796 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:786 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1581 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1572 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:787 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:798 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [9] IncludeInto @ ./Base.jl:311 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 517: [ Info: Starting test worker 1 on pid = 517, with 2 threads [ Info: Starting running test items Worker 517: 17:31:48 | maxrss 2.2% | mem 3.1% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 517 [517] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7d7f10a70f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7d7f10a741c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7d7f10af485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7d7f10a70f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=517, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=517, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 524: [ Info: Starting test worker 1 on pid = 524, with 2 threads [ Info: Starting running test items Worker 524: 17:32:04 | maxrss 2.2% | mem 3.1% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 524 [524] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7dc3e70b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7dc3e70b41c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7dc3e713485b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7dc3e70b0f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=524, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=524, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 531: [ Info: Starting test worker 1 on pid = 531, with 2 threads [ Info: Starting running test items Worker 531: 17:32:20 | maxrss 2.2% | mem 3.1% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 531 [531] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7ca4a0fb9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7ca4a0fbd1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7ca4a103d85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7ca4a0fb9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=531, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=531, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 545: [ Info: Starting test worker 1 on pid = 545, with 3,2 threads [ Info: Starting running test items Worker 545: 17:32:51 | maxrss 2.2% | mem 3.1% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 545: 17:32:51 | maxrss 2.2% | mem 3.1% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (95.3% compile), 20.80 K allocs (1.132 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=545). Worker 545: [545] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:874 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:908. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.12 seconds. [ Info: Scheduling 3 tests on pid 91 17:32:55 | maxrss 2.2% | mem 2.3% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.15 K allocs (63.968 KB) 17:32:55 | maxrss 2.2% | mem 2.3% | START (2/3) test item "other A" at test/integrationtests.jl:900 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.32 K allocs (76.432 KB) 17:32:55 | maxrss 2.2% | mem 2.3% | START (3/3) test item "other B" at test/integrationtests.jl:900 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 91 17:32:55 | maxrss 2.2% | mem 2.3% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.15 K allocs (63.968 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:32:55 | maxrss 2.2% | mem 2.3% | START (1/2) test item "other A" at test/integrationtests.jl:900 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) 17:32:55 | maxrss 2.2% | mem 2.3% | START (2/2) test item "other B" at test/integrationtests.jl:900 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (79.464 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 17:32:55 | maxrss 2.2% | mem 2.3% | START (1/1) test item "other B" at test/integrationtests.jl:900 17:32:55 | maxrss 2.2% | mem 2.3% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.57 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:32:56 | maxrss 2.2% | mem 2.3% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 17:32:56 | maxrss 2.2% | mem 2.3% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) 17:32:56 | maxrss 2.2% | mem 2.3% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 17:32:56 | maxrss 2.2% | mem 2.3% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 555: [ Info: Starting test worker 1 on pid = 555, with 2 threads [ Info: Starting running test items Worker 555: 17:33:08 | maxrss 2.2% | mem 3.1% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 555: 17:33:09 | maxrss 2.2% | mem 3.1% | DONE (1/2) test item "same name" 0.2 secs (96.4% compile), 20.58 K allocs (1.132 MB) Worker 555: 17:33:10 | maxrss 2.2% | mem 3.1% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 555: 17:33:10 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.09 K allocs (63.248 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=555). Worker 555: [555] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 562: [ Info: Starting test worker 1 on pid = 562, with 2 threads [ Info: Starting running test items Worker 562: [562] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7e61896aaf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 562 ┌ Error: Worker(pid=562, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 569: [ Info: Starting test worker on pid = 569, with 2 threads Worker 569: [569] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 569 ┌ Error: Worker(pid=569, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=569, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:38:52 | maxrss 2.2% | mem 2.3% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 17:38:52 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) 17:38:52 | maxrss 2.2% | mem 2.3% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 17:38:52 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) 17:38:52 | maxrss 2.2% | mem 2.3% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 17:38:53 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 17:38:53 | maxrss 2.2% | mem 2.3% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 17:38:53 | maxrss 2.2% | mem 2.3% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 1.70 K allocs (83.344 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 91 Error in testset "happy 1" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 17:38:53 | maxrss 2.2% | mem 2.3% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 17:38:53 | maxrss 2.2% | mem 2.3% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.70 K allocs (84.976 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 91 Error in testset "happy 2" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 17:38:53 | maxrss 2.2% | mem 2.3% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 17:38:53 | maxrss 2.2% | mem 2.3% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.70 K allocs (86.456 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 91 Error in testset "happy 3" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 742: [ Info: Starting test worker 1 on pid = 742, with 2 threads [ Info: Starting running test items Worker 742: 17:39:06 | maxrss 2.2% | mem 3.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 742: 17:39:06 | maxrss 2.2% | mem 3.1% | DONE (1/3) test item "happy 1" 0.2 secs (94.7% compile), 21.24 K allocs (1.146 MB) Worker 742: 17:39:07 | maxrss 2.2% | mem 3.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 742: 17:39:07 | maxrss 2.2% | mem 3.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.20 K allocs (101.984 KB) Worker 742: 17:39:08 | maxrss 2.2% | mem 3.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 742: 17:39:08 | maxrss 2.2% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.20 K allocs (100.656 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=742). Worker 742: [742] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 749: [ Info: Starting test worker 1 on pid = 749, with 2 threads [ Info: Starting running test items Worker 749: 17:39:22 | maxrss 2.2% | mem 3.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 749: 17:39:22 | maxrss 2.2% | mem 3.1% | DONE (1/3) test item "happy 1" 0.2 secs (95.5% compile), 20.75 K allocs (1.129 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 749 Error in testset "happy 1" on worker 749: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 749: 17:39:23 | maxrss 2.2% | mem 3.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 749: 17:39:23 | maxrss 2.2% | mem 3.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.71 K allocs (84.928 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 749 Error in testset "happy 2" on worker 749: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 749: 17:39:25 | maxrss 2.2% | mem 3.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 749: 17:39:25 | maxrss 2.2% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.71 K allocs (83.600 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 749 Error in testset "happy 3" on worker 749: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=749). Worker 749: [749] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 758: [ Info: Starting test worker 2 on pid = 758, with 2 threads Worker 756: [ Info: Starting test worker 1 on pid = 756, with 2 threads [ Info: Starting running test items Worker 756: 17:39:53 | maxrss 2.2% | mem 3.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 758: 17:39:53 | maxrss 2.2% | mem 3.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 756: 17:39:54 | maxrss 2.2% | mem 3.9% | DONE (1/3) test item "happy 1" 0.5 secs (93.0% compile), 21.24 K allocs (1.146 MB) Worker 758: 17:39:54 | maxrss 2.2% | mem 3.9% | DONE (2/3) test item "happy 2" 0.5 secs (93.8% compile), 21.24 K allocs (1.146 MB) Worker 756: 17:39:57 | maxrss 2.2% | mem 3.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 [ Info: All tests on worker 2 completed. Closing Worker(pid=758). Worker 756: 17:39:57 | maxrss 2.2% | mem 3.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.20 K allocs (102.016 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=756). Worker 756: [756] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 770: [ Info: Starting test worker 1 on pid = 770, with 2 threads Worker 772: [ Info: Starting test worker 2 on pid = 772, with 2 threads [ Info: Starting running test items Worker 770: 17:40:26 | maxrss 2.2% | mem 3.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 772: 17:40:26 | maxrss 2.2% | mem 3.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 770: 17:40:27 | maxrss 2.2% | mem 3.9% | DONE (1/3) test item "happy 1" 0.5 secs (95.9% compile), 20.75 K allocs (1.129 MB) Worker 772: 17:40:27 | maxrss 2.2% | mem 3.9% | DONE (2/3) test item "happy 2" 0.5 secs (96.3% compile), 20.75 K allocs (1.129 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 770 Error in testset "happy 1" on worker 770: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 772 Error in testset "happy 2" on worker 772: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 770: 17:40:30 | maxrss 2.2% | mem 3.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 [ Info: All tests on worker 2 completed. Closing Worker(pid=772). Worker 770: 17:40:30 | maxrss 2.2% | mem 3.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.71 K allocs (84.960 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 770 Error in testset "happy 3" on worker 770: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=770). Worker 770: [770] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 784: [ Info: Starting test worker 1 on pid = 784, with 2 threads [ Info: Starting running test items Worker 784: 17:40:45 | maxrss 2.2% | mem 3.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 784: 17:40:46 | maxrss 2.2% | mem 3.1% | DONE (1/3) test item "happy 1" 0.2 secs (95.7% compile), 21.24 K allocs (1.157 MB) Worker 784: 17:40:47 | maxrss 2.2% | mem 3.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 784: 17:40:47 | maxrss 2.2% | mem 3.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.61 K allocs (81.424 KB) Worker 784: 17:40:47 | maxrss 2.2% | mem 3.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 784: 17:40:47 | maxrss 2.2% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.61 K allocs (80.096 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=784). Worker 784: [784] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1143 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 16.0s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1143 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 791: [ Info: Starting test worker 1 on pid = 791, with 2 threads [ Info: Starting running test items Worker 791: 17:41:00 | maxrss 2.2% | mem 3.1% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 791: 17:41:00 | maxrss 2.2% | mem 3.1% | DONE (1/3) test item "happy 1" 0.3 secs (96.1% compile), 53.05 K allocs (2.946 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 791 Error in testset "post-testitem" on worker 791: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false Worker 791: 17:41:02 | maxrss 2.2% | mem 3.1% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 791: 17:41:02 | maxrss 2.2% | mem 3.1% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.23 K allocs (137.704 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 791 Error in testset "post-testitem" on worker 791: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false Worker 791: 17:41:03 | maxrss 2.2% | mem 3.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 791: 17:41:03 | maxrss 2.2% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.23 K allocs (136.408 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 791 Error in testset "post-testitem" on worker 791: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=791). Worker 791: [791] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1165 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 16.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.3s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1165 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1172 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 16.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.3s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1172 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1287 [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 800: [ Info: Starting test worker 1 on pid = 800, with 2 threads [ Info: Starting running test items Worker 800: 17:41:16 | maxrss 2.2% | mem 3.1% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 800: 17:41:16 | maxrss 2.2% | mem 3.1% | DONE (1/2) test item "correct usage" 0.3 secs (97.5% compile), 65.43 K allocs (3.674 MB) Worker 800: 17:41:17 | maxrss 2.2% | mem 3.1% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 800: 17:41:17 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item "incorrect usage" <0.1 secs (76.8% compile), 2.39 K allocs (129.584 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=800). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 807: [ Info: Starting test worker 1 on pid = 807, with 2 threads [ Info: Starting running test items Worker 807: 17:41:31 | maxrss 2.2% | mem 3.1% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 807: 17:41:32 | maxrss 2.2% | mem 3.1% | DONE (1/2) test item "correct usage" 0.7 secs (97.5% compile), 257.91 K allocs (14.672 MB) Worker 807: 17:41:34 | maxrss 2.2% | mem 3.1% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 807: 17:41:34 | maxrss 2.2% | mem 3.1% | DONE (2/2) test item "incorrect usage" <0.1 secs (56.5% compile), 5.05 K allocs (227.544 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 807 Error in testset "no pins left at end of test" on worker 807: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1198 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=807). Worker 807: [807] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 9 tests on pid 91 17:41:36 | maxrss 2.2% | mem 2.4% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (1/9) test item "do_thing Pass" <0.1 secs (81.9% compile), 8.40 K allocs (491.424 KB) 17:41:36 | maxrss 2.2% | mem 2.4% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.21 K allocs (107.584 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 91 [ Info: RUNNING Error in testset "do_thing Fail" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.9991146544710365, 0.2589386718891218, 0.696245854681901] == 1 17:41:36 | maxrss 2.2% | mem 2.4% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (3/9) test item "do_thing Error" 0.1 secs (<0.1% compile), 52.84 K allocs (7.515 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 91 [ Info: RUNNING Error in testset "do_thing Error" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 17:41:36 | maxrss 2.2% | mem 2.4% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (4/9) test item "bad setup, good test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 91 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 91 Error in testset "bad setup, good test" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [28] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [29] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [31] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [36] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [38] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [45] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [46] IncludeInto @ ./Base.jl:311 [inlined] [47] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [48] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [49] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [50] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [51] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [52] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [53] top-level scope @ none:6 [54] eval(m::Module, e::Any) @ Core ./boot.jl:489 [55] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:41:36 | maxrss 2.2% | mem 2.4% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 91 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 91 Error in testset "bad setup, bad test" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [28] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [29] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [31] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [36] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [38] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [45] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [46] IncludeInto @ ./Base.jl:311 [inlined] [47] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [48] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [49] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [50] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [51] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [52] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [53] top-level scope @ none:6 [54] eval(m::Module, e::Any) @ Core ./boot.jl:489 [55] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:41:36 | maxrss 2.2% | mem 2.4% | START (6/9) test item "errors" at test/error_tests.jl:1 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (6/9) test item "errors" <0.1 secs (<0.1% compile), 26.69 K allocs (1.868 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 91 [ Info: RUNNING Error in testset "UndefVarError" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#911"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#911"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [32] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [33] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [35] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [40] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [42] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [50] IncludeInto @ ./Base.jl:311 [inlined] [51] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [52] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [55] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [56] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [57] top-level scope @ none:6 [58] eval(m::Module, e::Any) @ Core ./boot.jl:489 [59] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:41:36 | maxrss 2.2% | mem 2.4% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (7/9) test item "errors at the top level" <0.1 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 91 [ Info: RUNNING Error in testset "errors at the top level" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [23] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [24] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [26] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [31] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [33] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [40] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [41] IncludeInto @ ./Base.jl:311 [inlined] [42] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [43] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [47] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [48] top-level scope @ none:6 [49] eval(m::Module, e::Any) @ Core ./boot.jl:489 [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:41:36 | maxrss 2.2% | mem 2.4% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (8/9) test item "nonexistent test setup" <0.1 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 91 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 91: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [25] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1469 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [35] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [43] IncludeInto @ ./Base.jl:311 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 17:41:36 | maxrss 2.2% | mem 2.4% | START (9/9) test item "failures" at test/failure_tests.jl:1 17:41:36 | maxrss 2.2% | mem 2.4% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.41 K allocs (156.736 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 91 [ Info: RUNNING Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.30978988914465877 < 0 Error in testset "failures" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 0.3s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.0s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.1s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.0s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 0.1s UndefVarError | 2 2 0.0s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.0s errors at the top level | 1 1 2 0.0s nonexistent test setup | 1 1 0.0s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1239. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1239 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1270. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 91 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 877: [ Info: Starting test worker 1 on pid = 877, with 2 threads [ Info: Starting running test items Worker 877: 17:43:58 | maxrss 2.3% | mem 3.2% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 877: 17:43:59 | maxrss 2.3% | mem 3.2% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (96.2% compile), 20.58 K allocs (1.132 MB) Worker 877: 17:43:59 | maxrss 2.3% | mem 3.2% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 877: 17:44:00 | maxrss 2.3% | mem 3.2% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.49 K allocs (78.288 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 877 Error in testset "skip false, 1 pass, 1 fail" on worker 877: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_skip_tests.jl:8 Expression: false Worker 877: 17:44:01 | maxrss 2.3% | mem 3.2% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 877: 17:44:02 | maxrss 2.3% | mem 3.2% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 877: 17:44:02 | maxrss 2.3% | mem 3.2% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.49 K allocs (76.880 KB) Worker 877: 17:44:02 | maxrss 2.3% | mem 3.2% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 No Captured Logs for test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 on worker 877 ┌ Error: Worker(pid=877, terminated=true, termsignal=-2147483648) died running test item "skip expr block true". Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:683 [ Info: All tests on worker 1 completed. Closing Worker(pid=877, terminated=true, termsignal=-2147483648). Worker 877: [877] signal 15: Terminated skipping testitems: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1278 Got exception outside of a @test MethodError: no method matching print_test_results(::Error) The function `print_test_results` exists, but no method is defined for this combination of argument types. Closest candidates are: print_test_results(!Matched::Test.AbstractTestSet) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1261 print_test_results(!Matched::Test.AbstractTestSet, !Matched::Any) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1261 Stacktrace: [1] (::var"#596#597"{Error})() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1284 [2] (::IOCapture.var"#12#13"{Type{Any}, var"#596#597"{Error}, IOContext{Base.PipeEndpoint}, IOContext{Base.PipeEndpoint}, Base.PipeEndpoint, Base.PipeEndpoint})() @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:170 [3] with_logstate(f::IOCapture.var"#12#13"{Type{Any}, var"#596#597"{Error}, IOContext{Base.PipeEndpoint}, IOContext{Base.PipeEndpoint}, Base.PipeEndpoint, Base.PipeEndpoint}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [4] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [5] capture(f::var"#596#597"{Error}; rethrow::Type, color::Bool, passthrough::Bool, capture_buffer::IOBuffer, io_context::Vector{Any}) @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:167 [6] capture(f::Function) @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:100 [7] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1280 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [11] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1283 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] IncludeInto @ ./Base.jl:311 [inlined] [14] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [15] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [16] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:489 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [23] _start() @ Base ./client.jl:553 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl 17:44:15 | maxrss 2.3% | mem 3.0% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:6 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Test Summary: | Fail Total Time should fail | 1 1 5.9s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 91 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 895: [ Info: Starting test worker 1 on pid = 895, with 2 threads\n Worker 897: [ Info: Starting test worker 2 on pid = 897, with 2 threads\n Worker 898: [ Info: Starting test worker 3 on pid = 898, with 2 threads\n[ Info: Starting running test items\n Worker 895: [895] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x722801fadf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 898: [898] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x78dd1945af14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 897: [897] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x770b3ea21f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 898\n┌ Error: Worker(pid=898, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 895\n┌ Error: Worker(pid=895, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 897\n┌ Error: Worker(pid=897, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 916: [ Info: Starting test worker on pid = 916, with 2 threads\n Worker 920: [ Info: Starting test worker on pid = 920, with 2 threads\n Worker 918: [ Info: Starting test worker on pid = 918, with 2 threads\n Worker 916: [916] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x79ddbf3c5f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 920: [920] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7f963c07df14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 918: [918] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7b561d73ff14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 916\n┌ Error: Worker(pid=916, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=916, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 920\n┌ Error: Worker(pid=920, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 2 completed. Closing Worker(pid=920, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 918\n┌ Error: Worker(pid=918, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 1 completed. Closing Worker(pid=918, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 91 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 1002: [ Info: Starting test worker 2 on pid = 1002, with 2 threads\n Worker 1003: [ Info: Starting test worker 3 on pid = 1003, with 2 threads\n Worker 1000: [ Info: Starting test worker 1 on pid = 1000, with 2 threads\n[ Info: Starting running test items\n Worker 1002: [1002] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7c673cf3af14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1003: [1003] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x77a7b641bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1000: [1000] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7cb79228bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 1003\n┌ Error: Worker(pid=1003, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 1002\n┌ Error: Worker(pid=1002, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 1000\n┌ Error: Worker(pid=1000, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 1023: [ Info: Starting test worker on pid = 1023, with 2 threads\n Worker 1024: [ Info: Starting test worker on pid = 1024, with 2 threads\n Worker 1021: [ Info: Starting test worker on pid = 1021, with 2 threads\n Worker 1023: [1023] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7ae6ab39af14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1024: [1024] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7529a7b11f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1021: [1021] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7d9409bd6f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 1024\n┌ Error: Worker(pid=1024, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=1024, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 1023\n┌ Error: Worker(pid=1023, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 2 completed. Closing Worker(pid=1023, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 1021\n┌ Error: Worker(pid=1021, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 3 completed. Closing Worker(pid=1021, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds.\n[ Info: Scheduling 3 tests on pid 91 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 1056: [ Info: Starting test worker 1 on pid = 1056, with 2 threads\n Worker 1059: [ Info: Starting test worker 3 on pid = 1059, with 2 threads\n Worker 1058: [ Info: Starting test worker 2 on pid = 1058, with 2 threads\n[ Info: Starting running test items\n Worker 1056: [1056] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x771c3ec41f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1058: [1058] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x720e8e5b9f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1059: [1059] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x78d690f57f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 1056\n┌ Error: Worker(pid=1056, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\n\nNo Captured LogsNo Captured Logs for test item \"may not run\" at for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:7test/testfiles/_failfast_crash_tests.jl:4 on worker 1059\n┌ Error: Worker(pid=1059, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n on worker 1058[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\n┌ Error: Worker(pid=1058, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 1077: [ Info: Starting test worker on pid = 1077, with 2 threads\n Worker 1081: [ Info: Starting test worker on pid = 1081, with 2 threads\n Worker 1079: [ Info: Starting test worker on pid = 1079, with 2 threads\n Worker 1077: [1077] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x71093226cf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1081: [1081] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x734fd5d34f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 1079: [1079] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7334592b0f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 1077\n┌ Error: Worker(pid=1077, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=1077, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 1081\n┌ Error: Worker(pid=1081, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 2 completed. Closing Worker(pid=1081, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 1079\n┌ Error: Worker(pid=1079, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 3 completed. Closing Worker(pid=1079, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1858 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1947 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 91 17:51:01 | maxrss 2.3% | mem 2.3% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 17:51:01 | maxrss 2.3% | mem 2.3% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 91 Error in testset "test set" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 91 17:51:03 | maxrss 2.3% | mem 2.3% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 17:51:03 | maxrss 2.3% | mem 2.3% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 91 Error in testset "Failure at toplevel" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 17:51:03 | maxrss 2.3% | mem 2.3% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 17:51:04 | maxrss 2.3% | mem 2.3% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 91 Error in testset "Bar" on worker 91: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. 17:51:18 | maxrss 2.4% | mem 3.3% | START test item "uses println" at _test_log_capture.jl:8 17:51:18 | maxrss 2.4% | mem 3.3% | DONE test item "uses println" 0.2 secs (98.8% compile), 101.37 K allocs (6.479 MB) 17:51:19 | maxrss 2.4% | mem 3.3% | START test item "uses println" at _test_log_capture.jl:21 17:51:19 | maxrss 2.4% | mem 3.3% | DONE test item "uses println" <0.1 secs (78.3% compile), 1.69 K allocs (238.368 KB) 17:51:19 | maxrss 2.4% | mem 3.3% | START test item "uses printstyled" at _test_log_capture.jl:34 17:51:19 | maxrss 2.4% | mem 3.3% | DONE test item "uses printstyled" 0.5 secs (99.5% compile), 357.47 K allocs (21.982 MB) 17:51:20 | maxrss 2.4% | mem 3.3% | START test item "uses @error" at _test_log_capture.jl:47 17:51:20 | maxrss 2.4% | mem 3.3% | DONE test item "uses @error" 0.2 secs (97.3% compile), 28.48 K allocs (1.794 MB) 17:51:20 | maxrss 2.4% | mem 3.3% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 17:51:21 | maxrss 2.4% | mem 3.3% | DONE test item "uses @test_logs @info" 0.4 secs (96.6% compile), 34.39 K allocs (2.076 MB) 17:51:21 | maxrss 2.4% | mem 3.3% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 17:51:21 | maxrss 2.4% | mem 3.3% | DONE test item "uses @test_logs @error" <0.1 secs (76.1% compile), 9.14 K allocs (593.928 KB) 17:51:21 | maxrss 2.4% | mem 3.3% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 17:51:22 | maxrss 2.4% | mem 3.3% | DONE test item "uses redirect_stdout" 0.2 secs (95.7% compile), 35.59 K allocs (2.239 MB) 17:51:22 | maxrss 2.4% | mem 3.3% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 17:51:22 | maxrss 2.4% | mem 3.3% | DONE test item "uses redirect_stderr" 0.2 secs (96.1% compile), 34.03 K allocs (2.158 MB) 17:51:22 | maxrss 2.4% | mem 3.3% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 17:51:23 | maxrss 2.4% | mem 3.3% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (96.1% compile), 127.75 K allocs (7.663 MB) 17:51:23 | maxrss 2.4% | mem 3.3% | START test item "uses with_logger" at _test_log_capture.jl:149 17:51:23 | maxrss 2.4% | mem 3.3% | DONE test item "uses with_logger" <0.1 secs (90.0% compile), 13.66 K allocs (979.592 KB) 17:51:23 | maxrss 2.4% | mem 3.3% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 17:51:24 | maxrss 2.4% | mem 3.3% | DONE test item "uses display" 0.5 secs (99.6% compile), 210.43 K allocs (12.509 MB) 17:51:24 | maxrss 2.4% | mem 3.3% | START test item "setup uses println" at _test_log_capture.jl:184 17:51:25 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses println" <0.1 secs, 812 allocs (53.424 KB) 17:51:25 | maxrss 2.4% | mem 3.3% | START test item "setup uses println" at _test_log_capture.jl:199 17:51:25 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses println" <0.1 secs, 813 allocs (55.056 KB) 17:51:25 | maxrss 2.4% | mem 3.3% | START test item "setup uses printstyled" at _test_log_capture.jl:214 17:51:25 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses printstyled" <0.1 secs, 814 allocs (54.160 KB) 17:51:25 | maxrss 2.4% | mem 3.3% | START test item "setup uses @error" at _test_log_capture.jl:229 17:51:25 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses @error" <0.1 secs, 812 allocs (53.424 KB) 17:51:26 | maxrss 2.4% | mem 3.3% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 17:51:26 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.43 K allocs (76.992 KB) 17:51:26 | maxrss 2.4% | mem 3.3% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 17:51:26 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.43 K allocs (76.992 KB) 17:51:26 | maxrss 2.4% | mem 3.3% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 17:51:26 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.42 K allocs (76.816 KB) 17:51:27 | maxrss 2.4% | mem 3.3% | START test item "setup uses with_logger" at _test_log_capture.jl:315 17:51:27 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses with_logger" <0.1 secs, 812 allocs (53.424 KB) 17:51:27 | maxrss 2.4% | mem 3.3% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 17:51:27 | maxrss 2.4% | mem 3.3% | DONE test item "setup uses display" <0.1 secs, 812 allocs (53.424 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 13.4s 17:51:38 | maxrss 2.4% | mem 3.2% | START test item "uses println" at _test_log_capture.jl:8 17:51:38 | maxrss 2.4% | mem 3.2% | DONE test item "uses println" <0.1 secs (93.0% compile), 21.43 K allocs (1.242 MB) 17:51:38 | maxrss 2.4% | mem 3.2% | START test item "uses println" at _test_log_capture.jl:21 17:51:38 | maxrss 2.4% | mem 3.2% | DONE test item "uses println" <0.1 secs (76.4% compile), 823 allocs (55.664 KB) 17:51:38 | maxrss 2.4% | mem 3.2% | START test item "uses printstyled" at _test_log_capture.jl:34 17:51:38 | maxrss 2.4% | mem 3.2% | DONE test item "uses printstyled" <0.1 secs (79.1% compile), 3.92 K allocs (250.240 KB) 17:51:38 | maxrss 2.4% | mem 3.2% | START test item "uses @error" at _test_log_capture.jl:47 17:51:38 | maxrss 2.4% | mem 3.2% | DONE test item "uses @error" 0.2 secs (96.9% compile), 18.00 K allocs (1.068 MB) 17:51:39 | maxrss 2.4% | mem 3.2% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 17:51:39 | maxrss 2.4% | mem 3.2% | DONE test item "uses @test_logs @info" 0.3 secs (96.9% compile), 34.44 K allocs (2.078 MB) 17:51:39 | maxrss 2.4% | mem 3.2% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 17:51:39 | maxrss 2.4% | mem 3.2% | DONE test item "uses @test_logs @error" <0.1 secs (70.0% compile), 9.19 K allocs (596.376 KB) 17:51:39 | maxrss 2.4% | mem 3.2% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 17:51:39 | maxrss 2.4% | mem 3.2% | DONE test item "uses redirect_stdout" 0.2 secs (95.7% compile), 35.63 K allocs (2.241 MB) 17:51:39 | maxrss 2.4% | mem 3.2% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 17:51:39 | maxrss 2.4% | mem 3.2% | DONE test item "uses redirect_stderr" 0.2 secs (96.2% compile), 34.07 K allocs (2.160 MB) 17:51:39 | maxrss 2.4% | mem 3.2% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 17:51:40 | maxrss 2.4% | mem 3.2% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (98.1% compile, 52.2% GC), 127.79 K allocs (7.666 MB) 17:51:40 | maxrss 2.4% | mem 3.2% | START test item "uses with_logger" at _test_log_capture.jl:149 17:51:40 | maxrss 2.4% | mem 3.2% | DONE test item "uses with_logger" <0.1 secs (86.5% compile), 9.97 K allocs (646.520 KB) 17:51:40 | maxrss 2.4% | mem 3.2% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 17:51:41 | maxrss 2.4% | mem 3.2% | DONE test item "uses display" 1.1 secs (99.7% compile), 575.84 K allocs (34.741 MB) 17:51:41 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:184 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 855 allocs (55.744 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:199 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 856 allocs (57.376 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses printstyled" at _test_log_capture.jl:214 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses printstyled" <0.1 secs, 857 allocs (56.512 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses @error" at _test_log_capture.jl:229 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses @error" <0.1 secs, 855 allocs (55.744 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.46 K allocs (79.296 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger" at _test_log_capture.jl:315 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger" <0.1 secs, 855 allocs (55.776 KB) 17:51:42 | maxrss 2.4% | mem 3.2% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 17:51:42 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses display" <0.1 secs, 855 allocs (55.744 KB) Test Summary: | Pass Broken Total Time log capture logs=:batched |  26  2  28 7.7s 17:51:53 | maxrss 2.4% | mem 3.2% | START test item "uses println" at _test_log_capture.jl:8 17:51:54 | maxrss 2.4% | mem 3.2% | DONE test item "uses println" <0.1 secs (62.3% compile), 21.43 K allocs (1.242 MB) 17:51:54 | maxrss 2.4% | mem 3.2% | START test item "uses println" at _test_log_capture.jl:21 17:51:54 | maxrss 2.4% | mem 3.2% | DONE test item "uses println" <0.1 secs (21.2% compile), 823 allocs (55.664 KB) 17:51:54 | maxrss 2.4% | mem 3.2% | START test item "uses printstyled" at _test_log_capture.jl:34 17:51:54 | maxrss 2.4% | mem 3.2% | DONE test item "uses printstyled" <0.1 secs (17.2% compile), 3.92 K allocs (250.240 KB) 17:51:54 | maxrss 2.4% | mem 3.2% | START test item "uses @error" at _test_log_capture.jl:47 17:51:54 | maxrss 2.4% | mem 3.2% | DONE test item "uses @error" 0.2 secs (88.1% compile), 18.00 K allocs (1.068 MB) 17:51:54 | maxrss 2.4% | mem 3.2% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 17:51:55 | maxrss 2.4% | mem 3.2% | DONE test item "uses @test_logs @info" 0.3 secs (93.2% compile), 34.44 K allocs (2.078 MB) 17:51:55 | maxrss 2.4% | mem 3.2% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 17:51:55 | maxrss 2.4% | mem 3.2% | DONE test item "uses @test_logs @error" <0.1 secs (47.3% compile), 9.19 K allocs (596.408 KB) 17:51:55 | maxrss 2.4% | mem 3.2% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 17:51:55 | maxrss 2.4% | mem 3.2% | DONE test item "uses redirect_stdout" 0.3 secs (54.3% compile), 35.63 K allocs (2.241 MB) 17:51:55 | maxrss 2.4% | mem 3.2% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 17:51:55 | maxrss 2.4% | mem 3.2% | DONE test item "uses redirect_stderr" 0.3 secs (57.7% compile), 34.07 K allocs (2.160 MB) 17:51:55 | maxrss 2.4% | mem 3.2% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 17:51:56 | maxrss 2.4% | mem 3.2% | DONE test item "uses with_logger (redirect to a file)" 0.7 secs (83.4% compile, 46.0% GC), 127.79 K allocs (7.666 MB) 17:51:56 | maxrss 2.4% | mem 3.2% | START test item "uses with_logger" at _test_log_capture.jl:149 17:51:56 | maxrss 2.4% | mem 3.2% | DONE test item "uses with_logger" <0.1 secs (51.0% compile), 9.97 K allocs (646.520 KB) 17:51:56 | maxrss 2.4% | mem 3.2% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 17:51:57 | maxrss 2.4% | mem 3.2% | DONE test item "uses display" 1.0 secs (99.8% compile), 575.84 K allocs (34.741 MB) 17:51:57 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:184 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 855 allocs (55.744 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:199 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 856 allocs (57.376 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses printstyled" at _test_log_capture.jl:214 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses printstyled" <0.1 secs, 857 allocs (56.512 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses @error" at _test_log_capture.jl:229 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses @error" <0.1 secs, 855 allocs (55.744 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.46 K allocs (79.296 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses with_logger" at _test_log_capture.jl:315 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses with_logger" <0.1 secs, 855 allocs (55.776 KB) 17:51:58 | maxrss 2.4% | mem 3.2% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 17:51:58 | maxrss 2.4% | mem 3.2% | DONE test item "setup uses display" <0.1 secs, 855 allocs (55.744 KB) Test Summary: | Pass Broken Total Time log capture logs=:issues |  26  2  28 8.5s ┌ Warning: Skipping JUnit XML reference tests on unrelease Julia version │ VERSION = v"1.13.0-DEV.873" └ @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:31 Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 1642 28 9 3 1682 39m48.2s workers.jl | 35 5 40 1m07.8s correct connected/running states (Worker(pid=95)) | 7 7 0.5s clean shutdown (Worker(pid=95)) | 6 6 2.2s more forceful shutdown (Worker(pid=100)) | 7 7 0.6s remote_eval/remote_fetch (Worker(pid=105)) | 5 5 5.0s worker crashing (Worker(pid=110)) | 7 7 2.4s remote_eval (Worker(pid=115)) | 2 2 3.3s CPU profile | 1 5 6 20.2s internals.jl | 416 1 5 422 15.8s get_starting_testitems | 300 300 2.9s is_test_file | 20 20 0.0s is_testsetup_file | 5 5 0.0s _is_subproject | 7 7 0.1s include_testfiles! | 4 1 5 8.0s only requested testfiles included | 1 1 5.3s testsetup files always included | 4 4 2.8s report_empty_testsets | 6 6 1.0s JUnit _error_message | 2 2 0.1s _validated_nworker_threads | 19 19 0.1s _validated_paths | 13 13 0.3s skiptestitem | 4 4 0.7s should_skip | 3 1 4 8 2.3s filtering.jl | 21 21 0.3s nestedrelpath | 12 12 0.0s macros.jl | 75 1 76 11.0s testsetup macro basic | 1 1 0.0s testitem macro basic | 4 4 2.8s testitem with `tags` | 3 3 0.2s testitem with `retries` | 3 3 0.2s testitem with macro import | 2 2 1.6s testitem with `setup` | 5 5 0.7s testsetup and testitem with includes | 3 3 0.2s missing testsetup | 1 1 0.4s testitem with duplicate keywords | 1 1 0.5s can identity if in a `@testitem` | 2 2 0.0s testitem macro runs immediately outside `runtests` | 6 6 1.1s manually specify `source` location | 4 4 0.0s testsetup not given module | 2 2 1.4s testitem `_id` keyword | 6 6 0.9s testitem `timeout` keyword | 8 8 0.6s testitem `skip` keyword | 11 1 12 0.1s tesitem `failfast` keyword | 2 2 0.1s testitem with `default_imports` | 6 6 0.2s testitem with unrecognised keyword | 1 1 0.0s testitem without a body | 4 4 0.0s integrationtests.jl | 379 22 3 3 407 36m42.3s manual `runtests(dir)` | 2 2 14.5s manual `runtests(file)` | 2 2 0.3s `runtests(path)` auto finds testsetups | 3 3 3.7s Warn or error when not test file | 11 11 3.8s filter `runtests(func, x)` | 12 1 13 13.8s `@testitem` scoping rules | 1 1 0.2s single-process | 12 2 1 15 3m22.8s Pkg.test() NoDeps.jl | 1 1 27.9s Pkg.test() TestsInSrc.jl | 1 1 23.9s Pkg.test() TestProjectFile.jl | 1 1 47.2s Pkg.test() TestEndExpr.jl | 1 1 1m01.9s Pkg.test() DontPass.jl | 1 1 35.7s runtests() NoDeps.jl | 2 2 0.2s runtests() TestsInSrc.jl | 2 2 0.1s runtests() TestProjectFile.jl | 2 2 2.7s runtests() TestEndExpr.jl | 1 1 0.0s runtests() DontPass.jl | 3 3 3.4s runtests a dir with 0 nworkers but worker_init_expr set | 2 2 0.7s runtests with nworkers = 2 | 10 10 5m45.6s Pkg.test() NoDeps.jl | 2 2 1m06.3s Pkg.test() TestsInSrc.jl | 2 2 1m14.6s Pkg.test() TestProjectFile.jl | 2 2 1m01.5s Pkg.test() TestEndExpr.jl | 2 2 48.8s Pkg.test() DontPass.jl | 2 2 1m34.5s don't recurse into subpackages | 2 2 3.9s trigger subpackage tests | 3 3 25.3s passing file (not dir) | 1 1 0.2s passing multiple files/dirs | 4 4 3.9s print report sorted | 2 2 1.1s `verbose_results`, `debug` and `logs` keywords | 48 48 1.2s `report=true` is not compatible with `logs=:eager` | 1 1 0.2s filter `runtests(x; tags)` | 8 8 6.2s filter `runtests(x; name)` | 7 7 5.5s filter `runtests(x; name, tags)` | 7 7 7.3s filter `runtests(func, x; name, tags)` | 8 8 12.3s Warn on empty test set -- integration test | 3 3 0.1s log capture for an errored TestSetup | 2 2 4 22.0s test crashing testitem | 4 4 27.4s test retrying failing testitem | 3 5 8 4m34.1s bugfix: `runtests` in a testset | 2 2 1.2s testitem_timeout | 1 1 1 3 26.7s testitem_timeout set via env variable | 1 1 1 3 27.2s @testitem `timeout` | 12 12 47.5s Error outside `@testitem` | 2 2 0.0s `runtests` finds no testitems | 2 2 0.1s Worker log capture on a failing test is not reported twice | 1 1 15.2s Worker and nworker_threads argument | 1 1 14.7s _redirect_logs and custom loggers | 1 1 0.4s error on code outside `@testitem`/`@testsetup` | 10 10 2.6s Duplicate names in same file throws | 2 2 0.1s Duplicate names in different files allowed | 2 2 15.1s Duplicate IDs not allowed | 2 2 0.0s Timeout failures accurately record elapsed time | 1 1 25.5s CPU profile timeout trigger | 16 16 3m20.1s worker always crashes immediately | 4 4 1m02.0s worker crashes immediately but succeeds on retry | 3 3 53.9s test_end_expr | 21 3 24 2m43.3s nworkers=0 | 5 5 0.7s nworkers=1 | 5 5 33.1s nworkers=2 | 5 5 1m06.4s report printing | 2 3 5 33.0s TestEndExpr.jl package | 4 4 30.0s test_end_expr always runs, even if testitem throws | 2 2 0.6s Replace workers when we hit memory threshold | 7 7 2m04.6s skipping testitems | 1 1 24.1s logs are aligned | 3 3 0.5s ParseError in test file | 2 2 1.5s invalid testitem combined with filter function | 24 24 0.1s error code from running `@testitem` directly | 1 1 15.3s runtests `failfast` keyword | 61 7 2 70 6m38.2s failure | 16 2 18 1m27.4s nworkers=0 | 6 6 0.6s nworkers=1 | 6 6 16.7s nworkers=3 | 4 2 6 1m10.2s error | 17 1 18 1m29.0s nworkers=0 | 6 6 0.1s nworkers=1 | 6 6 18.2s nworkers=3 | 5 1 6 1m10.7s timeout | 10 2 1 13 1m42.4s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 33.0s nworkers=3 | 4 2 6 1m09.4s crash | 10 2 1 13 1m26.9s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 27.8s nworkers=3 | 4 2 6 59.1s multiple failures | 5 5 32.1s ENV var | 3 3 0.5s Handle `@testset failfast=true` | 3 3 0.2s DONE time reported when testitem throws | 2 2 0.9s runtests `testitem_failfast` keyword | 27 27 3.3s `test_end_expr` must be `:block` | 1 1 0.2s warn if no test items | 4 4 1.1s log_capture.jl | 52 52 1m11.8s log capture | 3 3 53.0s Workers print in color | 1 1 18.0s log capture -- reporting | 12 12 0.3s default_log_display_mode | 20 20 0.0s print_time | 16 16 0.6s tests removed workers | 684 684 0.0s RNG of the outermost testset: Random.Xoshiro(0x2f361b6894259bf8, 0x5aaf5a2d9ff6a514, 0x45b68a0f1a89aa61, 0x208b7244c3e435e8, 0x7fa4fc1e53f75871) ERROR: LoadError: Some tests did not pass: 1642 passed, 28 failed, 9 errored, 3 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:13 Testing failed after 2345.0s ERROR: LoadError: Package ReTestItems errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2661 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2510 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:537 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:168 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [7] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:155 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:309 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:320 [12] _start() @ Base ./client.jl:553 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval crashed after 2482.16s: an internal error was encountered ################################################################################ # Bug reporting # The package crashed during testing (reason=internal), but PkgEval was unable to reproduce the crash under rr (status=kill, reason=time_limit). For debugging, here is the tail end of the rr log: > > signal (10): User defined signal 1 > epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) > uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 > uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 > ijl_task_get_next at /source/src/scheduler.c:457 > wait at ./task.jl:1192 > wait_forever at ./task.jl:1129 > jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) > _jl_invoke at /source/src/gf.c:3807 [inlined] > ijl_apply_generic at /source/src/gf.c:4004 > jl_apply at /source/src/julia.h:2345 [inlined] > start_task at /source/src/task.c:1249 > unknown function (ip: (nil)) at (unknown file) > > ============================================================== > Profile collected. A report will print at the next yield point > ============================================================== > > ┌ Warning: There were no samples collected in one or more groups. > │ This may be due to idle threads, or you may need to run your > │ program longer (perhaps by running it multiple times), > │ or adjust the delay between samples with `Profile.init()`. > └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362 > Overhead ╎ [+additional indent] Count File:Line Function > ========================================================= > Thread 1 (default) Task 0x000076eb2d41c5b0 Total snapshots: 688. Utilization: 0% > ╎688 @Base/task.jl:1129 wait_forever() > 687╎ 688 @Base/task.jl:1192 wait() > > > ====================================================================================== > Information request received. A stacktrace will print followed by a 1.0 second profile > ====================================================================================== > > cmd: /opt/julia/bin/julia 1 running 0 of 1 > > signal (10): User defined signal 1 > epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) > uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 > uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 > ijl_task_get_next at /source/src/scheduler.c:457 > wait at ./task.jl:1192 > wait_forever at ./task.jl:1129 > jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) > _jl_invoke at /source/src/gf.c:3807 [inlined] > ijl_apply_generic at /source/src/gf.c:4004 > jl_apply at /source/src/julia.h:2345 [inlined] > start_task at /source/src/task.c:1249 > unknown function (ip: (nil)) at (unknown file) > > ============================================================== > Profile collected. A report will print at the next yield point > ============================================================== > > ┌ Warning: There were no samples collected in one or more groups. > │ This may be due to idle threads, or you may need to run your > │ program longer (perhaps by running it multiple times), > │ or adjust the delay between samples with `Profile.init()`. > └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362 > Overhead ╎ [+additional indent] Count File:Line Function > ========================================================= > Thread 1 (default) Task 0x00007e6523df3b20 Total snapshots: 723. Utilization: 0% > ╎723 @Base/task.jl:1129 wait_forever() > 722╎ 723 @Base/task.jl:1192 wait() > > > [294] signal 15: Terminated > in expression starting at /home/pkgeval/bugreport.jl:13 > epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) > uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 > uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 > ijl_task_get_next at /source/src/scheduler.c:457 > wait at ./task.jl:1192 > wait_forever at ./task.jl:1129 > jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) > _jl_invoke at /source/src/gf.c:3807 [inlined] > ijl_apply_generic at /source/src/gf.c:4004 > jl_apply at /source/src/julia.h:2345 [inlined] > start_task at /source/src/task.c:1249 > unknown function (ip: (nil)) at (unknown file) > Allocations: 8745215 (Pool: 8745099; Big: 116); GC: 7 > > [1] signal 15: Terminated > in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 > epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) > uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 > uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 > ijl_task_get_next at /source/src/scheduler.c:457 > wait at ./task.jl:1192 > wait_forever at ./task.jl:1129 > jfptr_wait_forever_68198.1 at /opt/julia/lib/julia/sys.so (unknown line) > _jl_invoke at /source/src/gf.c:3807 [inlined] > ijl_apply_generic at /source/src/gf.c:4004 > jl_apply at /source/src/julia.h:2345 [inlined] > start_task at /source/src/task.c:1249 > unknown function (ip: (nil)) at (unknown file) > Allocations: 14134945 (Pool: 14134665; Big: 280); GC: 27 > > PkgEval terminated after 2742.68s: test duration exceeded the time limit