Package evaluation of ReTestItems on Julia 1.13.0-DEV.843 (7634fdf1d6*) started at 2025-07-10T12:40:32.099 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 10.08s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Installed ReTestItems ─ v1.32.0 Updating `~/.julia/environments/v1.13/Project.toml` [817f1d60] + ReTestItems v1.32.0 Updating `~/.julia/environments/v1.13/Manifest.toml` [817f1d60] + ReTestItems v1.32.0 [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] + Pkg v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.65.0+0 [3f19e933] + p7zip_jll v17.5.0+2 Installation completed after 1.01s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling packages... 4728.3 ms ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 26 already precompiled. Precompiling package dependencies... Precompilation completed after 43.89s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_Wa7lxv/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.32.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [ade2ca70] Dates v1.11.0 [56ddb016] Logging v1.11.0 [44cfe95a] Pkg v1.13.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_Wa7lxv/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.1 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.0 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.32.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 ⌅ [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9abbd945] Profile v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Worker 98: [98] signal 15: Terminated Worker 103: [103] signal 15: Terminated Worker 113: [113] signal 15: Terminated CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:110 Expression: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 118: ======================================================================================\n Worker 118: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 118: ======================================================================================\n Worker 118: cmd: /opt/julia/bin/julia 118 running 3 of 7\n Worker 118: signal (10): User defined signal 1\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b33a10d9) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 118: _ZN4llvm4UsernwEmNS0_28IntrusiveOperandsAllocMarkerE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 118: Create at /source/usr/include/llvm/IR/Instructions.h:3075 [inlined]\n Worker 118: CreateBr at /source/usr/include/llvm/IR/IRBuilder.h:1159\n Worker 118: emit_function at /source/src/codegen.cpp:9303\n Worker 118: jl_emit_code at /source/src/codegen.cpp:9786\n Worker 118: jl_emit_codeinst at /source/src/codegen.cpp:9857\n Worker 118: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:827\n Worker 118: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 118: jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: jl_type_infer at /source/src/gf.c:462\n Worker 118: jl_compile_method_internal at /source/src/gf.c:3292\n Worker 118: _jl_invoke at /source/src/gf.c:3785 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 118: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: ==============================================================\n Worker 118: Profile collected. A report will print at the next yield point\n Worker 118: ==============================================================\n Worker 118: ┌ Warning: There were no samples collected in one or more groups.\n Worker 118: │ This may be due to idle threads, or you may need to run your\n Worker 118: │ program longer (perhaps by running it multiple times),\n Worker 118: │ or adjust the delay between samples with `Profile.init()`.\n Worker 118: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 118: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 118: =========================================================\n Worker 118: Thread 1 (interactive) Task 0x000071669bce70d0 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 2 (interactive) Task 0x000071669d1fc100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 3 (default) Task 0x000071669be0b490 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 4 (default) Task 0x000071669d1f4100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 5 (default) Task 0x000071669d1f0100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 6 (foreign: gc) Task 0x000071669d1ec010 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 7 (foreign: gc) Task 0x000071669d1e8010 Total snapshots: 39. Utilization: 100%\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:110 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:111 Expression: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 118: ======================================================================================\n Worker 118: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 118: ======================================================================================\n Worker 118: cmd: /opt/julia/bin/julia 118 running 3 of 7\n Worker 118: signal (10): User defined signal 1\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b33a10d9) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 118: _ZN4llvm4UsernwEmNS0_28IntrusiveOperandsAllocMarkerE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 118: Create at /source/usr/include/llvm/IR/Instructions.h:3075 [inlined]\n Worker 118: CreateBr at /source/usr/include/llvm/IR/IRBuilder.h:1159\n Worker 118: emit_function at /source/src/codegen.cpp:9303\n Worker 118: jl_emit_code at /source/src/codegen.cpp:9786\n Worker 118: jl_emit_codeinst at /source/src/codegen.cpp:9857\n Worker 118: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:827\n Worker 118: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 118: jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: jl_type_infer at /source/src/gf.c:462\n Worker 118: jl_compile_method_internal at /source/src/gf.c:3292\n Worker 118: _jl_invoke at /source/src/gf.c:3785 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 118: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: ==============================================================\n Worker 118: Profile collected. A report will print at the next yield point\n Worker 118: ==============================================================\n Worker 118: ┌ Warning: There were no samples collected in one or more groups.\n Worker 118: │ This may be due to idle threads, or you may need to run your\n Worker 118: │ program longer (perhaps by running it multiple times),\n Worker 118: │ or adjust the delay between samples with `Profile.init()`.\n Worker 118: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 118: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 118: =========================================================\n Worker 118: Thread 1 (interactive) Task 0x000071669bce70d0 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 2 (interactive) Task 0x000071669d1fc100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 3 (default) Task 0x000071669be0b490 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 4 (default) Task 0x000071669d1f4100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 5 (default) Task 0x000071669d1f0100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 6 (foreign: gc) Task 0x000071669d1ec010 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 7 (foreign: gc) Task 0x000071669d1e8010 Total snapshots: 39. Utilization: 100%\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:111 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:112 Expression: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 118: ======================================================================================\n Worker 118: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 118: ======================================================================================\n Worker 118: cmd: /opt/julia/bin/julia 118 running 3 of 7\n Worker 118: signal (10): User defined signal 1\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b33a10d9) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 118: _ZN4llvm4UsernwEmNS0_28IntrusiveOperandsAllocMarkerE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 118: Create at /source/usr/include/llvm/IR/Instructions.h:3075 [inlined]\n Worker 118: CreateBr at /source/usr/include/llvm/IR/IRBuilder.h:1159\n Worker 118: emit_function at /source/src/codegen.cpp:9303\n Worker 118: jl_emit_code at /source/src/codegen.cpp:9786\n Worker 118: jl_emit_codeinst at /source/src/codegen.cpp:9857\n Worker 118: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:827\n Worker 118: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 118: jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: jl_type_infer at /source/src/gf.c:462\n Worker 118: jl_compile_method_internal at /source/src/gf.c:3292\n Worker 118: _jl_invoke at /source/src/gf.c:3785 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 118: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: ==============================================================\n Worker 118: Profile collected. A report will print at the next yield point\n Worker 118: ==============================================================\n Worker 118: ┌ Warning: There were no samples collected in one or more groups.\n Worker 118: │ This may be due to idle threads, or you may need to run your\n Worker 118: │ program longer (perhaps by running it multiple times),\n Worker 118: │ or adjust the delay between samples with `Profile.init()`.\n Worker 118: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 118: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 118: =========================================================\n Worker 118: Thread 1 (interactive) Task 0x000071669bce70d0 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 2 (interactive) Task 0x000071669d1fc100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 3 (default) Task 0x000071669be0b490 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 4 (default) Task 0x000071669d1f4100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 5 (default) Task 0x000071669d1f0100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 6 (foreign: gc) Task 0x000071669d1ec010 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 7 (foreign: gc) Task 0x000071669d1e8010 Total snapshots: 39. Utilization: 100%\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:112 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:114 Expression: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 118: ======================================================================================\n Worker 118: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 118: ======================================================================================\n Worker 118: cmd: /opt/julia/bin/julia 118 running 3 of 7\n Worker 118: signal (10): User defined signal 1\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b33a10d9) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 118: _ZN4llvm4UsernwEmNS0_28IntrusiveOperandsAllocMarkerE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 118: Create at /source/usr/include/llvm/IR/Instructions.h:3075 [inlined]\n Worker 118: CreateBr at /source/usr/include/llvm/IR/IRBuilder.h:1159\n Worker 118: emit_function at /source/src/codegen.cpp:9303\n Worker 118: jl_emit_code at /source/src/codegen.cpp:9786\n Worker 118: jl_emit_codeinst at /source/src/codegen.cpp:9857\n Worker 118: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:827\n Worker 118: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 118: jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: jl_type_infer at /source/src/gf.c:462\n Worker 118: jl_compile_method_internal at /source/src/gf.c:3292\n Worker 118: _jl_invoke at /source/src/gf.c:3785 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 118: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: ==============================================================\n Worker 118: Profile collected. A report will print at the next yield point\n Worker 118: ==============================================================\n Worker 118: ┌ Warning: There were no samples collected in one or more groups.\n Worker 118: │ This may be due to idle threads, or you may need to run your\n Worker 118: │ program longer (perhaps by running it multiple times),\n Worker 118: │ or adjust the delay between samples with `Profile.init()`.\n Worker 118: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 118: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 118: =========================================================\n Worker 118: Thread 1 (interactive) Task 0x000071669bce70d0 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 2 (interactive) Task 0x000071669d1fc100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 3 (default) Task 0x000071669be0b490 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 4 (default) Task 0x000071669d1f4100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 5 (default) Task 0x000071669d1f0100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 6 (foreign: gc) Task 0x000071669d1ec010 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 7 (foreign: gc) Task 0x000071669d1e8010 Total snapshots: 39. Utilization: 100%\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:114 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/workers.jl:115 Expression: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 118: ======================================================================================\n Worker 118: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 118: ======================================================================================\n Worker 118: cmd: /opt/julia/bin/julia 118 running 3 of 7\n Worker 118: signal (10): User defined signal 1\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654\n Worker 118: unknown function (ip: 0x7166b33921c3) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: 0x7166b341285b) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b33a10d9) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: operator new at /workspace/srcdir/gcc-14.2.0/libstdc++-v3/libsupc++/new_op.cc:50\n Worker 118: _ZN4llvm4UsernwEmNS0_28IntrusiveOperandsAllocMarkerE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line)\n Worker 118: Create at /source/usr/include/llvm/IR/Instructions.h:3075 [inlined]\n Worker 118: CreateBr at /source/usr/include/llvm/IR/IRBuilder.h:1159\n Worker 118: emit_function at /source/src/codegen.cpp:9303\n Worker 118: jl_emit_code at /source/src/codegen.cpp:9786\n Worker 118: jl_emit_codeinst at /source/src/codegen.cpp:9857\n Worker 118: jl_emit_codeinst_to_jit_impl at /source/src/jitlayers.cpp:827\n Worker 118: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1555\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562\n Worker 118: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570\n Worker 118: jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: jl_type_infer at /source/src/gf.c:462\n Worker 118: jl_compile_method_internal at /source/src/gf.c:3292\n Worker 118: _jl_invoke at /source/src/gf.c:3785 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: unknown function (ip: 0x7166b338ef14) at /lib/x86_64-linux-gnu/libc.so.6\n Worker 118: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:523\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 118: uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404\n Worker 118: uv_run at /workspace/srcdir/libuv/src/unix/core.c:430\n Worker 118: ijl_task_get_next at /source/src/scheduler.c:457\n Worker 118: wait at ./task.jl:1213\n Worker 118: wait_forever at ./task.jl:1150\n Worker 118: jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 118: _jl_invoke at /source/src/gf.c:3793 [inlined]\n Worker 118: ijl_apply_generic at /source/src/gf.c:3993\n Worker 118: jl_apply at /source/src/julia.h:2345 [inlined]\n Worker 118: start_task at /source/src/task.c:1249\n Worker 118: unknown function (ip: (nil)) at (unknown file)\n Worker 118: ==============================================================\n Worker 118: Profile collected. A report will print at the next yield point\n Worker 118: ==============================================================\n Worker 118: ┌ Warning: There were no samples collected in one or more groups.\n Worker 118: │ This may be due to idle threads, or you may need to run your\n Worker 118: │ program longer (perhaps by running it multiple times),\n Worker 118: │ or adjust the delay between samples with `Profile.init()`.\n Worker 118: └ @ Profile /opt/julia/share/julia/stdlib/v1.13/Profile/src/Profile.jl:1362\n Worker 118: Overhead ╎ [+additional indent] Count File:Line Function\n Worker 118: =========================================================\n Worker 118: Thread 1 (interactive) Task 0x000071669bce70d0 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 2 (interactive) Task 0x000071669d1fc100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 3 (default) Task 0x000071669be0b490 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 4 (default) Task 0x000071669d1f4100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 5 (default) Task 0x000071669d1f0100 Total snapshots: 39. Utilization: 0%\n Worker 118: ╎39 @Base/task.jl:1150 wait_forever()\n Worker 118: 38╎ 39 @Base/task.jl:1213 wait()\n Worker 118: Thread 6 (foreign: gc) Task 0x000071669d1ec010 Total snapshots: 39. Utilization: 100%\n Worker 118: Thread 7 (foreign: gc) Task 0x000071669d1e8010 Total snapshots: 39. Utilization: 100%\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:98 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/workers.jl:115 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] only requested testfiles included: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:90 Got exception outside of a @test IOError: readdir("/this/file"): no such file or directory (ENOENT) Stacktrace: [1] iterate(c::Channel{Tuple{String, Vector{String}, Vector{String}}}, state::Nothing) @ Base ./channels.jl:724 [2] iterate @ ./channels.jl:707 [inlined] [3] macro expansion @ ./task.jl:633 [inlined] [4] include_testfiles!(project_name::String, projectfile::String, paths::Tuple{String}, ti_filter::TestItemFilter{Returns{Bool}, Nothing, Nothing}, verbose_results::Bool, report::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:789 [5] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:90 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:91 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [11] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:97 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] IncludeInto @ ./Base.jl:311 [inlined] [14] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:19 [15] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [16] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:489 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [23] _start() @ Base ./client.jl:553 ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:132 12:43:10 | maxrss 1.7% | mem 1.9% | SKIP (0/1) test item "skip" at internals.jl:288 should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:311 Test threw exception Expression: should_skip(ti) UndefVarError: `##skip#292` not defined in `Main.var"##skip_x#291"` The binding may be too new: running in world age 39006, while current world is 39008. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:311 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:313 Test threw exception Expression: !(should_skip(ti)) UndefVarError: `##skip#294` not defined in `Main.var"##skip_x#293"` The binding may be too new: running in world age 39008, while current world is 39010. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:313 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:316 Test threw exception Expression: should_skip(ti) UndefVarError: `##skip#296` not defined in `Main.var"##skip_x#295"` The binding may be too new: running in world age 39010, while current world is 39013. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:316 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:318 Test threw exception Expression: !(should_skip(ti)) UndefVarError: `##skip#298` not defined in `Main.var"##skip_x#297"` The binding may be too new: running in world age 39013, while current world is 39016. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] eval_test_function(func::Any, args::Any, kwargs::Any, quoted_func::Union{Expr, Symbol}, source::LineNumberNode, negate::Bool) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:384 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:318 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] should_skip: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/internals.jl:321 Expression: should_skip(ti) Expected: "Test item \"x\" `skip` keyword must be a `Bool`, got `skip=2`" Message: "UndefVarError: `##skip#300` not defined in `Main.var\"##skip_x#299\"`\nThe binding may be too new: running in world age 39016, while current world is 39019." Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:7 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:303 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/internals.jl:321 [inlined] 12:43:17 | maxrss 1.7% | mem 1.9% | START test item "TI1" at macros.jl:32 12:43:17 | maxrss 1.7% | mem 1.9% | DONE test item "TI1" 0.1 secs (97.9% compile), 114.75 K allocs (6.816 MB) 12:43:17 | maxrss 1.7% | mem 1.9% | START test item "TI2" at macros.jl:43 12:43:17 | maxrss 1.7% | mem 1.9% | DONE test item "TI2" <0.1 secs (<0.1% compile), 993 allocs (55.552 KB) 12:43:18 | maxrss 1.7% | mem 1.9% | START test item "TI" at macros.jl:53 12:43:18 | maxrss 1.7% | mem 1.9% | DONE test item "TI" <0.1 secs (<0.1% compile), 993 allocs (55.584 KB) 12:43:18 | maxrss 1.7% | mem 1.9% | START test item "macro-import" at macros.jl:64 12:43:19 | maxrss 1.7% | mem 1.9% | DONE test item "macro-import" 1.5 secs (95.7% compile, 3.4% GC), 567.34 K allocs (32.153 MB) 12:43:19 | maxrss 1.7% | mem 1.9% | START test item "Foo" at macros.jl:95 12:43:20 | maxrss 1.7% | mem 1.9% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.38 K allocs (106.832 KB) 12:43:20 | maxrss 1.7% | mem 1.9% | START test item "Foo3" at macros.jl:110 12:43:20 | maxrss 1.7% | mem 1.9% | DONE test item "Foo3" <0.1 secs (<0.1% compile), 1.98 K allocs (93.296 KB) 12:43:21 | maxrss 1.7% | mem 1.9% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:109 [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [10] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [11] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [12] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1018 [13] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:23 [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:118 [inlined] [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [17] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:123 [inlined] [18] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [19] IncludeInto @ ./Base.jl:311 [inlined] [20] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:20 [21] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [22] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [24] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [25] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [26] top-level scope @ none:6 [27] eval(m::Module, e::Any) @ Core ./boot.jl:489 [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [29] _start() @ Base ./client.jl:553 12:43:21 | maxrss 1.7% | mem 1.9% | DONE test item "Foo4" 12:43:21 | maxrss 1.7% | mem 1.9% | START test item "testitem active" at macros.jl:138 12:43:21 | maxrss 1.7% | mem 1.9% | DONE test item "testitem active" <0.1 secs (82.2% compile), 2.86 K allocs (152.416 KB) 12:43:21 | maxrss 1.7% | mem 1.9% | START test item "run" at macros.jl:146 12:43:21 | maxrss 1.7% | mem 1.9% | DONE test item "run" <0.1 secs (<0.1% compile), 992 allocs (57.024 KB) 12:43:22 | maxrss 1.7% | mem 1.9% | START test item "comparisons" at macros.jl:182 12:43:22 | maxrss 1.7% | mem 1.9% | DONE test item "comparisons" 0.1 secs (79.7% compile), 14.81 K allocs (921.280 KB) 12:43:26 | maxrss 1.7% | mem 2.0% | SKIP test item "skip isa bool" at macros.jl:306 12:43:26 | maxrss 1.7% | mem 2.0% | SKIP test item "test contains error" at macros.jl:314 testitem `skip` keyword: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:295 Got exception outside of a @test UndefVarError: `##skip#362` not defined in `Main.var"##skip_skip isa expr 1#361"` The binding may be too new: running in world age 39171, while current world is 39173. Stacktrace: [1] should_skip(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:991 [2] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1031 [3] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [4] runtestitem(ti::TestItem; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1018 [5] runtestitem(ti::TestItem) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1010 [6] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:23 [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:296 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/macros.jl:341 [inlined] [11] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [12] IncludeInto @ ./Base.jl:311 [inlined] [13] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:20 [14] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [15] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [17] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [18] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [19] top-level scope @ none:6 [20] eval(m::Module, e::Any) @ Core ./boot.jl:489 [21] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [22] _start() @ Base ./client.jl:553 12:43:26 | maxrss 1.7% | mem 2.0% | START test item "default_imports" at macros.jl:424 12:43:26 | maxrss 1.7% | mem 2.0% | DONE test item "default_imports" <0.1 secs (<0.1% compile), 1.48 K allocs (73.408 KB) 12:43:26 | maxrss 1.7% | mem 2.0% | START test item "no_default_imports" at macros.jl:432 12:43:26 | maxrss 1.7% | mem 2.0% | DONE test item "no_default_imports" 0.2 secs (99.3% compile), 449.09 K allocs (25.800 MB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/RVvCj` Updating `~/.julia/packages/ReTestItems/RVvCj/Project.toml` [1e6cf692] + TestEnv v1.102.1 [ade2ca70] ~ Dates ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [44cfe95a] ~ Pkg ⇒ v1.13.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `~/.julia/packages/ReTestItems/RVvCj/Manifest.toml` [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.2 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] + Downloads v1.7.0 [7b1f6079] + FileWatching v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 v1.11.0 [8f399da3] + Libdl v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] + Markdown v1.11.0 [ca575930] + NetworkOptions v1.3.0 [44cfe95a] ~ Pkg ⇒ v1.13.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] + LibCURL_jll v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] + LibSSH2_jll v1.11.3+1 [14a3606d] + MozillaCACerts_jll v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] + Zlib_jll v1.3.1+2 [8e850ede] + nghttp2_jll v1.65.0+0 [3f19e933] + p7zip_jll v17.5.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:00 | maxrss 1.9% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 12:44:00 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.33 K allocs (74.608 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:00 | maxrss 1.9% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 12:44:00 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.24 K allocs (67.792 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nested [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:00 | maxrss 1.9% | mem 2.1% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 12:44:00 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.24 K allocs (67.424 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` 12:44:04 | maxrss 1.9% | mem 2.1% | START (1/1) test item "foo" at src/foo_test.jl:1 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "foo" 0.9 secs (2.3% compile), 49.79 K allocs (6.967 MB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 89 12:44:05 | maxrss 1.9% | mem 2.1% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (129.352 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.600 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.632 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:44:05 | maxrss 1.9% | mem 2.1% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) 12:44:05 | maxrss 1.9% | mem 2.1% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:44:06 | maxrss 1.9% | mem 2.1% | DONE (7/8) test item "bar" 0.7 secs (97.7% compile), 324.07 K allocs (17.425 MB) 12:44:06 | maxrss 1.9% | mem 2.1% | START (8/8) test item "foo" at src/foo_test.jl:1 12:44:06 | maxrss 1.9% | mem 2.1% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.05 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.06 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:09 | maxrss 1.9% | mem 2.1% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:44:09 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.02 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.16 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:12 | maxrss 1.9% | mem 2.1% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 12:44:12 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scheduling 1 tests on pid 89 12:44:13 | maxrss 1.9% | mem 2.1% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 12:44:13 | maxrss 1.9% | mem 2.1% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.23 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 1.1 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl filter `runtests(func, x)`: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 Expression: runtests((ti->begin #= /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 =# contains(ti.file, "bar_") end), pkg) Expected: "no field file" Message: "TaskFailedException\n\n nested task error: LoadError: FieldError: type ReTestItems.TestItemMetadata has no field `file`, available fields: `name`, `tags`\n Stacktrace:\n [1] getproperty\n @ ./Base_compiler.jl:57 [inlined]\n [2] (::var\"#327#328\")(ti::ReTestItems.TestItemMetadata)\n @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212\n [3] (::TestItemFilter{var\"#327#328\", Nothing, Nothing})(ti::ReTestItems.TestItemMetadata)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:19\n [4] filter_testitem(f::TestItemFilter{var\"#327#328\", Nothing, Nothing}, expr::Expr)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:62\n [5] TestItemFilter\n @ ~/.julia/packages/ReTestItems/RVvCj/src/filtering.jl:37 [inlined]\n [6] include_string(mapexpr::TestItemFilter{var\"#327#328\", Nothing, Nothing}, mod::Module, code::String, filename::String)\n @ Base ./loading.jl:2844\n [7] _include(mapexpr::Function, mod::Module, _path::String)\n @ Base ./loading.jl:2908\n [8] include(mapexpr::Function, mod::Module, _path::String)\n @ Base ./Base.jl:310\n [9] #include_testfiles!##10\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:825 [inlined]\n [10] task_local_storage(body::ReTestItems.var\"#include_testfiles!##10#include_testfiles!##11\"{TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Channel{Pair{Symbol, TestSetup}})\n @ Base ./task.jl:298\n [11] #include_testfiles!##8\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:824 [inlined]\n [12] task_local_storage(body::ReTestItems.var\"#include_testfiles!##8#include_testfiles!##9\"{Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::String)\n @ Base ./task.jl:298\n [13] #include_testfiles!##6\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:823 [inlined]\n [14] task_local_storage(body::ReTestItems.var\"#include_testfiles!##6#include_testfiles!##7\"{String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Tuple{ReTestItems.FileNode, Set{String}})\n @ Base ./task.jl:298\n [15] #include_testfiles!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:822 [inlined]\n [16] task_local_storage(body::ReTestItems.var\"#include_testfiles!##4#include_testfiles!##5\"{ReTestItems.FileNode, Set{String}, String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String}, key::Symbol, val::Bool)\n @ Base ./task.jl:298\n [17] (::ReTestItems.var\"#include_testfiles!##2#include_testfiles!##3\"{ReTestItems.FileNode, Set{String}, String, Channel{Pair{Symbol, TestSetup}}, TestItemFilter{var\"#327#328\", Nothing, Nothing}, String})()\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:821\n in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/bar_tests.jl:1\n\n...and 5 more exceptions.\n" Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:136 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:212 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 5 tests on pid 89 12:44:19 | maxrss 1.9% | mem 2.1% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 12:44:19 | maxrss 1.9% | mem 2.1% | DONE (1/5) test item "scope test - loops" <0.1 secs (<0.1% compile), 1.42 K allocs (75.264 KB) 12:44:19 | maxrss 1.9% | mem 2.1% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 12:44:19 | maxrss 1.9% | mem 2.1% | DONE (2/5) test item "scope test - setups" <0.1 secs (<0.1% compile), 1.56 K allocs (81.504 KB) 12:44:19 | maxrss 1.9% | mem 2.1% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 12:44:19 | maxrss 1.9% | mem 2.1% | DONE (3/5) test item "scope test - testsets" <0.1 secs (<0.1% compile), 2.79 K allocs (127.704 KB) 12:44:19 | maxrss 1.9% | mem 2.1% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 12:44:19 | maxrss 1.9% | mem 2.1% | DONE (4/5) test item "scope test - imports" <0.1 secs (61.1% compile), 6.53 K allocs (309.712 KB) 12:44:19 | maxrss 1.9% | mem 2.1% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 12:44:19 | maxrss 1.9% | mem 2.1% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.61 K allocs (119.448 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/Manifest.toml:0 ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Testing NoDeps Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_Yi7Pfs/Project.toml` [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_Yi7Pfs/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [2520ce14] + NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_Yi7Pfs/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] Test v1.11.0 Status `/tmp/jl_Yi7Pfs/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 5.35 seconds. [ Info: Scheduling 2 tests on pid 142 12:44:46 | maxrss 1.9% | mem 3.2% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 12:44:47 | maxrss 1.9% | mem 3.2% | DONE (1/2) test item "toplevel" 0.2 secs (97.2% compile), 15.32 K allocs (800.752 KB) 12:44:47 | maxrss 1.9% | mem 3.2% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 12:44:47 | maxrss 1.9% | mem 3.2% | DONE (2/2) test item "NoDeps-testitem" 0.2 secs (94.7% compile, 4.4% recompile), 34.71 K allocs (1.907 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 142 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.6s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.2s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.2s inner-testset | 1 1 0.0s Testing NoDeps tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Testing TestsInSrc Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_RniiQI/Project.toml` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_RniiQI/Manifest.toml` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [3520ce14] + TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_RniiQI/Project.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_RniiQI/Manifest.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 5.44 seconds. [ Info: Scheduling 8 tests on pid 146 12:45:10 | maxrss 1.9% | mem 3.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (1/8) test item "a1" 0.2 secs (96.6% compile), 16.01 K allocs (851.400 KB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (2/8) test item "a2" 0.2 secs (93.5% compile), 34.69 K allocs (1.903 MB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.03 K allocs (57.568 KB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.03 K allocs (57.600 KB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.03 K allocs (57.664 KB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:45:11 | maxrss 1.9% | mem 3.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.03 K allocs (57.392 KB) 12:45:11 | maxrss 1.9% | mem 3.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:45:12 | maxrss 1.9% | mem 3.2% | DONE (7/8) test item "bar" 0.8 secs (98.1% compile, 0.9% recompile), 549.38 K allocs (29.773 MB) 12:45:12 | maxrss 1.9% | mem 3.2% | START (8/8) test item "foo" at src/foo_test.jl:1 12:45:12 | maxrss 1.9% | mem 3.2% | DONE (8/8) test item "foo" <0.1 secs (73.8% compile), 3.34 K allocs (167.936 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.5s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.2s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.2s a2_testset | 1 1 0.0s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.8s bar values | 2 2 0.3s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Installed Example ─ v0.5.3 Testing TestProjectFile Test Could not use exact versions of packages in manifest. Re-resolving dependencies Installed Example ───────── v0.5.5 Installed Parsers ───────── v2.8.3 Installed PrecompileTools ─ v1.3.2 Installed InlineStrings ─── v1.0.0 Updating `/tmp/jl_5D0is3/Project.toml` [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_5D0is3/Manifest.toml` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [69de0a69] ↑ Parsers v2.5.8 ⇒ v2.8.3 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] ↑ Preferences v1.3.0 ⇒ v1.4.3 [817f1d60] ~ ReTestItems v1.1.1 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [66db9d55] - SnoopPrecompile v1.0.3 [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [7770ce14] + TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_5D0is3/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_5D0is3/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 885.9 ms ✓ Example 780.3 ms ✓ TestProjectFile 2 dependencies successfully precompiled in 2 seconds [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 5.53 seconds. [ Info: Scheduling 1 tests on pid 158 12:45:37 | maxrss 2.0% | mem 3.2% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 12:45:58 | maxrss 2.0% | mem 3.2% | DONE (1/1) test item "TestProjectFile" 21.0 secs (5.9% compile, 2.2% recompile), 919.92 K allocs (53.652 MB) Captured Logs for test item "TestProjectFile" at test/TestProjectFile-test.jl:1 on worker 158 Precompiling packages... 985.3 ms ✓ PrecompileTools 17216.8 ms ✓ Parsers 1331.1 ms ✓ InlineStrings 3 dependencies successfully precompiled in 20 seconds. 6 already precompiled. [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 24.2s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 21.0s test-only dep on InlineStrings | 1 1 20.6s Testing TestProjectFile tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Installed LoggingExtras ─ v1.0.1 Installed TestEnv ─────── v1.100.1 Testing TestEndExpr Status `/tmp/jl_vZiMRh/Project.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` [8dfed614] Test v1.11.0 Status `/tmp/jl_vZiMRh/Manifest.toml` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [loaded: v1.102.1] [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... Precompiling packages... 4661.8 ms ✓ TestEnv 6486.3 ms ✓ ReTestItems 2 dependencies successfully precompiled in 11 seconds. 29 already precompiled. Precompiling packages... 859.7 ms ✓ TestEndExpr 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 5.42 seconds. [ Info: Scheduling 2 tests on pid 188 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 204: [ Info: Starting test worker 1 on pid = 204, with 2 threads [ Info: Starting running test items Worker 204: 12:46:55 | maxrss 1.5% | mem 3.9% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 204: 12:46:56 | maxrss 1.5% | mem 3.9% | DONE (1/2) test item "correct usage" 0.3 secs (97.7% compile, 2.1% recompile), 68.76 K allocs (3.781 MB) Worker 204: 12:46:57 | maxrss 1.5% | mem 3.9% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 204: 12:46:57 | maxrss 1.5% | mem 3.9% | DONE (2/2) test item "incorrect usage" <0.1 secs (77.2% compile), 2.42 K allocs (128.256 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=204). Worker 204: [204] signal 15: Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 27.5s Testing TestEndExpr tests passed ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Testing DontPass Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_ANqXc3/Project.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_ANqXc3/Manifest.toml` [550ce164] + DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [37e2e46d] ~ LinearAlgebra ⇒ v1.12.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [4536629a] + OpenBLAS_jll v0.3.29+0 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850b90] + libblastrampoline_jll v5.13.1+0 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_ANqXc3/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [37e2e46d] LinearAlgebra v1.12.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_ANqXc3/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.13.1+0 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... Precompiling packages... 873.0 ms ✓ DontPass 1 dependency successfully precompiled in 1 seconds. 31 already precompiled. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 6.44 seconds. [ Info: Scheduling 9 tests on pid 211 12:47:24 | maxrss 2.0% | mem 3.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 12:47:25 | maxrss 2.0% | mem 3.2% | DONE (1/9) test item "do_thing Pass" 0.8 secs (99.0% compile, 1.2% recompile), 204.60 K allocs (10.683 MB) 12:47:25 | maxrss 2.0% | mem 3.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 12:47:25 | maxrss 2.0% | mem 3.2% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.3% compile), 114.85 K allocs (6.532 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 211 Error in testset "do_thing Fail" on worker 211: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.34841110098196115, 0.8705798819518387, 0.4038828043184802] == 1 12:47:26 | maxrss 2.0% | mem 3.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 12:47:31 | maxrss 2.0% | mem 3.3% | DONE (3/9) test item "do_thing Error" 5.0 secs (93.0% compile, 2.5% recompile, 3.0% GC), 3.88 M allocs (228.397 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 211 Error in testset "do_thing Error" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 12:47:31 | maxrss 2.0% | mem 3.3% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 12:47:32 | maxrss 2.0% | mem 3.3% | DONE (4/9) test item "bad setup, good test" 0.5 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 211 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 211 Error in testset "bad setup, good test" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [29] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [30] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 12:47:32 | maxrss 2.0% | mem 3.3% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 12:47:32 | maxrss 2.0% | mem 3.3% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 211 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 211 Error in testset "bad setup, bad test" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [29] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [30] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [31] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [32] top-level scope @ none:6 [33] eval(m::Module, e::Any) @ Core ./boot.jl:489 [34] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [35] _start() @ Base ./client.jl:553 12:47:32 | maxrss 2.0% | mem 3.3% | START (6/9) test item "errors" at test/error_tests.jl:1 12:47:34 | maxrss 2.0% | mem 3.3% | DONE (6/9) test item "errors" 1.7 secs (96.8% compile), 505.64 K allocs (28.983 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 211 Error in testset "UndefVarError" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#298"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#298"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [32] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [33] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [34] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [35] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [36] top-level scope @ none:6 [37] eval(m::Module, e::Any) @ Core ./boot.jl:489 [38] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [39] _start() @ Base ./client.jl:553 12:47:34 | maxrss 2.0% | mem 3.3% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 12:47:34 | maxrss 2.0% | mem 3.3% | DONE (7/9) test item "errors at the top level" 0.2 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 211 Error in testset "errors at the top level" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [24] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [27] top-level scope @ none:6 [28] eval(m::Module, e::Any) @ Core ./boot.jl:489 [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [30] _start() @ Base ./client.jl:553 12:47:34 | maxrss 2.0% | mem 3.3% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 12:47:34 | maxrss 2.0% | mem 3.3% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 211 Error in testset "nonexistent test setup" on worker 211: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:352 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] #runtests#32 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:249 [inlined] [25] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:246 [inlined] [26] #runtests#31 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:245 [inlined] [27] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [28] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [29] top-level scope @ none:6 [30] eval(m::Module, e::Any) @ Core ./boot.jl:489 [31] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [32] _start() @ Base ./client.jl:553 12:47:34 | maxrss 2.0% | mem 3.3% | START (9/9) test item "failures" at test/failure_tests.jl:1 12:47:34 | maxrss 2.0% | mem 3.3% | DONE (9/9) test item "failures" <0.1 secs (70.1% compile), 4.86 K allocs (243.760 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 211 Error in testset "failures" on worker 211: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 211: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.527605638390801 < 0 Error in testset "failures" on worker 211: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 14.1s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.8s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 5.0s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.5s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 2.0s UndefVarError | 2 2 1.4s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.1s errors at the top level | 1 1 2 0.2s nonexistent test setup | 1 1 0.1s test/failure_tests.jl | 3 3 failures | 3 3 0.0s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 89 12:47:37 | maxrss 2.0% | mem 2.1% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.08 K allocs (61.632 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.63 K allocs (122.400 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 89 12:47:37 | maxrss 2.0% | mem 2.1% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.320 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.760 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.872 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 12:47:37 | maxrss 2.0% | mem 2.1% | START (8/8) test item "foo" at src/foo_test.jl:1 12:47:37 | maxrss 2.0% | mem 2.1% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (84.528 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 runtests() TestProjectFile.jl: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:250 Expression: n_passed(results) > 0 Evaluated: 0 > 0 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:250 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] runtests() TestProjectFile.jl: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:251 Expression: all_passed(results) Evaluated: all_passed(Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:53 Got exception outside of a @test MethodError: no method matching prune_manifest(::Pkg.Types.Manifest, ::Vector{Base.UUID}) The function `prune_manifest` exists, but no method is defined for this combination of argument types. Closest candidates are: prune_manifest(::Pkg.Types.Manifest, !Matched::Set{Base.UUID}) @ Pkg /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:1232 prune_manifest(!Matched::Pkg.Types.EnvCache) @ Pkg /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:1211 Stacktrace: [1] activate(pkg::String; allow_reresolve::Bool) @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:40 [2] activate (repeats 2 times) @ ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:9 [inlined] [3] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:362 [4] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [5] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [6] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [7] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [8] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [9] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [10] #335 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:248 [inlined] [11] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [12] activate(f::var"#with_test_package##4#with_test_package##5"{var"#335#336"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [13] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [14] cd(f::var"#with_test_package##2#with_test_package##3"{var"#335#336"}, dir::String) @ Base.Filesystem ./file.jl:112 [15] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [18] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#335#336", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [19] with_test_package(f::var"#335#336", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [20] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [24] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [25] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [26] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:247 [inlined] [27] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [28] IncludeInto @ ./Base.jl:311 [inlined] [29] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [30] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [31] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [34] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [35] top-level scope @ none:6 [36] eval(m::Module, e::Any) @ Core ./boot.jl:489 [37] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [38] _start() @ Base ./client.jl:553) Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:240 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:251 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 89 12:47:41 | maxrss 2.0% | mem 2.1% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 12:47:41 | maxrss 2.0% | mem 2.1% | DONE (1/9) test item "do_thing Pass" <0.1 secs (78.6% compile), 13.54 K allocs (728.632 KB) 12:47:41 | maxrss 2.0% | mem 2.1% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 12:47:41 | maxrss 2.0% | mem 2.1% | DONE (2/9) test item "do_thing Fail" 0.3 secs (98.6% compile), 114.88 K allocs (6.560 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 89 Error in testset "do_thing Fail" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.814032664109667, 0.5519857785101333, 0.33292211303917296] == 1 12:47:41 | maxrss 2.0% | mem 2.1% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (3/9) test item "do_thing Error" 0.4 secs (65.1% compile), 140.11 K allocs (12.406 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 89 Error in testset "do_thing Error" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 12:47:42 | maxrss 2.0% | mem 2.1% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (4/9) test item "bad setup, good test" 0.2 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 89 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 89 Error in testset "bad setup, good test" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [29] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [30] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [31] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [32] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [33] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [34] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [37] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [38] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [39] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [46] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [47] IncludeInto @ ./Base.jl:311 [inlined] [48] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [49] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [50] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [51] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [52] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [53] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [54] top-level scope @ none:6 [55] eval(m::Module, e::Any) @ Core ./boot.jl:489 [56] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 12:47:42 | maxrss 2.0% | mem 2.1% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 89 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 89 Error in testset "bad setup, bad test" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [28] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [29] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [30] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [31] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [32] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [33] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [34] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [37] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [38] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [39] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [43] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [46] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [47] IncludeInto @ ./Base.jl:311 [inlined] [48] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [49] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [50] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [51] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [52] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [53] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [54] top-level scope @ none:6 [55] eval(m::Module, e::Any) @ Core ./boot.jl:489 [56] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 12:47:42 | maxrss 2.0% | mem 2.1% | START (6/9) test item "errors" at test/error_tests.jl:1 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (6/9) test item "errors" 0.1 secs (60.1% compile), 46.99 K allocs (3.001 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 89 Error in testset "UndefVarError" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#490"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#490"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [32] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [33] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [34] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [36] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [41] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [43] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [45] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [51] IncludeInto @ ./Base.jl:311 [inlined] [52] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [53] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [54] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [55] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [56] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [57] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [58] top-level scope @ none:6 [59] eval(m::Module, e::Any) @ Core ./boot.jl:489 [60] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 12:47:42 | maxrss 2.0% | mem 2.1% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (7/9) test item "errors at the top level" 0.1 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 89 Error in testset "errors at the top level" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [23] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [24] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [25] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [27] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [32] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [34] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [41] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [42] IncludeInto @ ./Base.jl:311 [inlined] [43] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [44] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [45] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [47] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [48] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [49] top-level scope @ none:6 [50] eval(m::Module, e::Any) @ Core ./boot.jl:489 [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 12:47:42 | maxrss 2.0% | mem 2.1% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (8/9) test item "nonexistent test setup" <0.1 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 89 Error in testset "nonexistent test setup" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:270 [25] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [26] #337 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:256 [inlined] [27] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [28] activate(f::var"#with_test_package##4#with_test_package##5"{var"#337#338"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [29] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [30] cd(f::var"#with_test_package##2#with_test_package##3"{var"#337#338"}, dir::String) @ Base.Filesystem ./file.jl:112 [31] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [32] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [33] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [34] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#337#338", String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [35] with_test_package(f::var"#337#338", name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [36] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:225 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:255 [inlined] --- the above 2 lines are repeated 1 more time --- [43] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [44] IncludeInto @ ./Base.jl:311 [inlined] [45] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [46] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [47] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [49] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [50] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [51] top-level scope @ none:6 [52] eval(m::Module, e::Any) @ Core ./boot.jl:489 [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 12:47:42 | maxrss 2.0% | mem 2.1% | START (9/9) test item "failures" at test/failure_tests.jl:1 12:47:42 | maxrss 2.0% | mem 2.1% | DONE (9/9) test item "failures" <0.1 secs (69.1% compile), 4.92 K allocs (248.624 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 89 Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.2952186906554431 < 0 Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 89 Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:53:40 | maxrss 2.0% | mem 2.2% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 12:53:43 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "MonoRepo tests" 3.2 secs (<0.1% compile), 62.17 K allocs (8.536 MB) [ Tests Completed: 1/1 test items were run. ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 Testing C Test Could not use exact versions of packages in manifest. Re-resolving dependencies Updating `/tmp/jl_jgIptS/Project.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] ~ Test ⇒ v1.11.0 Updating `/tmp/jl_jgIptS/Manifest.toml` [4ee78ca3] + C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [7876af07] + Example v0.5.5 [e6f89c97] - LoggingExtras v1.0.0 [817f1d60] ~ ReTestItems v0.1.0 `~/.julia/packages/ReTestItems/RVvCj` ⇒ v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] ↑ TestEnv v1.9.3 ⇒ v1.102.1 [c8ffd9c3] - MbedTLS_jll v2.28.0+0 [0dad84c5] ↑ ArgTools v1.1.1 ⇒ v1.1.2 [56f22d72] ~ Artifacts ⇒ v1.11.0 [2a0f44e3] ~ Base64 ⇒ v1.11.0 [ade2ca70] ~ Dates ⇒ v1.11.0 [f43a241f] ↑ Downloads v1.6.0 ⇒ v1.7.0 [7b1f6079] ~ FileWatching ⇒ v1.11.0 [b77e0a4c] ~ InteractiveUtils ⇒ v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [b27032c2] ↑ LibCURL v0.6.3 ⇒ v0.6.4 [76f85450] ~ LibGit2 ⇒ v1.11.0 [8f399da3] ~ Libdl ⇒ v1.11.0 [56ddb016] ~ Logging ⇒ v1.11.0 [d6f4376e] ~ Markdown ⇒ v1.11.0 [ca575930] ↑ NetworkOptions v1.2.0 ⇒ v1.3.0 [44cfe95a] ↑ Pkg v1.8.0 ⇒ v1.13.0 [de0858da] ~ Printf ⇒ v1.11.0 [3fa0cd96] - REPL [9a3f8284] ~ Random ⇒ v1.11.0 [9e88b42a] ~ Serialization ⇒ v1.11.0 [6462fe0b] ~ Sockets ⇒ v1.11.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] ↑ TOML v1.0.0 ⇒ v1.0.3 [a4e569a6] ↓ Tar v1.10.1 ⇒ v1.10.0 [8dfed614] ~ Test ⇒ v1.11.0 [cf7118a7] ~ UUIDs ⇒ v1.11.0 [4ec0a83e] ~ Unicode ⇒ v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] ↑ LibCURL_jll v7.84.0+0 ⇒ v8.14.1+1 [e37daf67] + LibGit2_jll v1.9.1+0 [29816b5a] ↑ LibSSH2_jll v1.10.2+0 ⇒ v1.11.3+1 [14a3606d] ↑ MozillaCACerts_jll v2022.2.1 ⇒ v2025.5.20 [458c3c95] + OpenSSL_jll v3.5.1+0 [efcefdf7] + PCRE2_jll v10.45.0+0 [83775a58] ↑ Zlib_jll v1.2.12+3 ⇒ v1.3.1+2 [8e850ede] ↑ nghttp2_jll v1.48.0+0 ⇒ v1.65.0+0 [3f19e933] ↑ p7zip_jll v17.4.0+0 ⇒ v17.5.0+2 Test Successfully re-resolved Status `/tmp/jl_jgIptS/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [8dfed614] Test v1.11.0 Status `/tmp/jl_jgIptS/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.32.0 `~/.julia/packages/ReTestItems/RVvCj` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.13.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.14.1+1 [e37daf67] LibGit2_jll v1.9.1+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.5.20 [458c3c95] OpenSSL_jll v3.5.1+0 [efcefdf7] PCRE2_jll v10.45.0+0 [83775a58] Zlib_jll v1.3.1+2 [8e850ede] nghttp2_jll v1.65.0+0 [3f19e933] p7zip_jll v17.5.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 5.66 seconds. [ Info: Scheduling 1 tests on pid 318 12:54:07 | maxrss 2.0% | mem 3.3% | START (1/1) test item "C_tests" at test/c_tests.jl:1 12:54:08 | maxrss 2.0% | mem 3.3% | DONE (1/1) test item "C_tests" 0.3 secs (96.4% compile, 3.5% recompile), 30.60 K allocs (1.695 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 4.5s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 0.3s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.11/activate_set.jl:75 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:10 | maxrss 2.0% | mem 2.2% | START (1/1) test item "C_tests" at test/c_tests.jl:1 12:54:10 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "C_tests" <0.1 secs (54.8% compile), 3.88 K allocs (234.688 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:11 | maxrss 2.0% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:54:11 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.42 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:12 | maxrss 2.0% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:54:12 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.968 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:13 | maxrss 2.0% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:54:13 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:13 | maxrss 2.0% | mem 2.2% | START (1/2) test item "bar" at src/bar_tests.jl:1 12:54:13 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 12:54:13 | maxrss 2.0% | mem 2.2% | START (2/2) test item "foo" at src/foo_test.jl:1 12:54:13 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 1.08 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:14 | maxrss 2.0% | mem 2.2% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:54:14 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 89 12:54:15 | maxrss 2.0% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.728 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (62.864 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (62.112 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 8 tests on pid 89 12:54:15 | maxrss 2.0% | mem 2.2% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.85 K allocs (128.728 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.08 K allocs (62.320 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.08 K allocs (61.504 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.08 K allocs (61.488 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 4.16 K allocs (176.424 KB) 12:54:15 | maxrss 2.0% | mem 2.2% | START (8/8) test item "foo" at src/foo_test.jl:1 12:54:15 | maxrss 2.0% | mem 2.2% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.69 K allocs (83.632 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:128 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:17 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:17 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (62.240 KB) 12:54:17 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:17 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:17 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:17 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.17 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:19 | maxrss 2.0% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:19 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:19 | maxrss 2.0% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:19 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.2 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:21 | maxrss 2.0% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:21 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:21 | maxrss 2.0% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:21 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:21 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:21 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:21 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:21 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 2.62 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:24 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:24 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.09 K allocs (63.848 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.95 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.21 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.25 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.06 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:26 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:26 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.09 K allocs (65.384 KB) 12:54:26 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:26 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.304 KB) 12:54:26 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:26 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:28 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:28 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.05 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:30 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:30 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.01 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:31 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:31 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:31 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:31 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:31 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:31 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (62.512 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:31 | maxrss 2.0% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:31 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:31 | maxrss 2.0% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:31 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:32 | maxrss 2.0% | mem 2.2% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:32 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:32 | maxrss 2.0% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:32 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:32 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:32 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:32 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:32 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:32 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:32 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (62.592 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.97 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.99 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:38 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:38 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:38 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 12:54:38 | maxrss 2.0% | mem 2.2% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:38 | maxrss 2.0% | mem 2.2% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:38 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 12:54:38 | maxrss 2.0% | mem 2.2% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:38 | maxrss 2.0% | mem 2.2% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.09 K allocs (64.296 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:39 | maxrss 2.0% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:39 | maxrss 2.0% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:39 | maxrss 2.0% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:39 | maxrss 2.0% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (62.768 KB) 12:54:39 | maxrss 2.0% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:39 | maxrss 2.0% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.04 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.06 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.1 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.13 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.11 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.15 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.07 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 1.09 seconds. [ Info: Scheduling 3 tests on pid 89 12:54:51 | maxrss 2.1% | mem 2.2% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:54:51 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) 12:54:51 | maxrss 2.1% | mem 2.2% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:54:51 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.08 K allocs (61.680 KB) 12:54:51 | maxrss 2.1% | mem 2.2% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:54:51 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.08 K allocs (61.696 KB) [ Tests Completed: 3/3 test items were run. 12:54:51 | maxrss 2.1% | mem 2.2% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 12:54:51 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 6.76 K allocs (275.672 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:650 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 322: [ Info: Starting test worker 1 on pid = 322, with 2 threads\n[ Info: Starting running test items\n Worker 322: 12:55:08 | maxrss 2.1% | mem 2.9% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 322: 12:55:11 | maxrss 2.1% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 3.0 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n Worker 322: 12:55:12 | maxrss 2.1% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 322: 12:55:12 | maxrss 2.1% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=322).\n Worker 322: [322] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:638 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:650 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:656 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds.\n[ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 322: [ Info: Starting test worker 1 on pid = 322, with 2 threads\n[ Info: Starting running test items\n Worker 322: 12:55:08 | maxrss 2.1% | mem 2.9% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 322: 12:55:11 | maxrss 2.1% | mem 3.1% | DONE (1/2) test item \"bad setup, good test\" 3.0 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n Worker 322: 12:55:12 | maxrss 2.1% | mem 3.1% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 322: 12:55:12 | maxrss 2.1% | mem 3.1% | DONE (2/2) test item \"bad setup, bad test\" <0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:2377 [inlined]\n [2] macro expansion\n @ ./lock.jl:376 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:2360\n [4] require\n @ ./loading.jl:2336 [inlined]\n [5] eval_import_path\n @ ./module.jl:36 [inlined]\n [6] eval_import_path_all(at::Module, path::Expr, keyword::String)\n @ Base ./module.jl:60\n [7] _eval_using(to::Module, path::Expr)\n @ Base ./module.jl:137\n [8] top-level scope\n @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3\n [9] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [10] #ensure_setup!##4\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [11] with_source_path(f::ReTestItems.var\"#ensure_setup!##4#ensure_setup!##5\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925\n [12] #ensure_setup!##2\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined]\n [13] redirect_stdio(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1448\n [14] redirect_stdio\n @ ./stream.jl:1411 [inlined]\n [15] _redirect_logs(f::ReTestItems.var\"#ensure_setup!##2#ensure_setup!##3\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124\n [16] macro expansion\n @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined]\n [17] macro expansion\n @ ./lock.jl:376 [inlined]\n [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937\n [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073\n [20] top-level scope\n @ none:1\n [21] eval(m::Module, e::Any)\n @ Core ./boot.jl:489\n [22] execute\n @ ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined]\n [23] (::ReTestItems.Workers.var\"#serve_requests##0#serve_requests##1\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=322).\n Worker 322: [322] signal 15: Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:638 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:656 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 343: [ Info: Starting test worker 1 on pid = 343, with 2 threads [ Info: Starting running test items Worker 343: 12:55:57 | maxrss 2.1% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 343: 12:55:58 | maxrss 2.1% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.9% compile), 7.35 K allocs (377.168 KB) Worker 343: [343] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 343 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 343 ┌ Error: Worker(pid=343, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 350: [ Info: Starting test worker on pid = 350, with 2 threads Worker 350: 12:56:12 | maxrss 2.1% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 350: 12:56:13 | maxrss 2.1% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.4% compile), 7.35 K allocs (377.168 KB) Worker 350: [350] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x70a77d842f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 350 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 350 ┌ Error: Worker(pid=350, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 357: [ Info: Starting test worker on pid = 357, with 2 threads Worker 357: 12:56:26 | maxrss 2.1% | mem 3.0% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 357: 12:56:27 | maxrss 2.1% | mem 3.0% | DONE (1/6) test item "Pass on second run" 0.2 secs (95.4% compile), 7.35 K allocs (377.168 KB) Worker 357: [357] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 357 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 357 ┌ Error: Worker(pid=357, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 364: [ Info: Starting test worker on pid = 364, with 2 threads Worker 364: 12:56:40 | maxrss 2.1% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 364 [364] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7135a48f7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7135a48fb1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7135a497b85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7135a48f7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) _useref_getindex at ./../usr/share/julia/Compiler/src/ssair/ir.jl:0 getindex at ./../usr/share/julia/Compiler/src/ssair/ir.jl:578 [inlined] renumber_ssa2! at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1351 process_node! at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1535 iterate_compact at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1949 iterate at ./../usr/share/julia/Compiler/src/ssair/ir.jl:1871 adce_pass! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:2103 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1033 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1046 optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1019 jfptr_optimize_83824.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:232 jfptr_finish_nocycle_85624.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4476 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3292 _jl_invoke at /source/src/gf.c:3785 [inlined] ijl_apply_generic at /source/src/gf.c:3993 show_exception_stack at ./errorshow.jl:1042 #sprint#442 at ./strings/io.jl:111 unknown function (ip: 0x71358906acbd) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 sprint at ./strings/io.jl:106 unknown function (ip: 0x71358906ab4d) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_f_invokelatest at /source/src/builtins.c:877 _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 invokelatest at ./Base_compiler.jl:253 _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 Error at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:227 do_test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:771 jfptr_do_test_4583.1 at /opt/julia/share/julia/compiled/v1.13/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_eval_module_expr at /source/src/toplevel.c:196 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:658 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 #72 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 #70 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 #redirect_stdio#653 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] #open#335 at ./io.jl:420 open at ./io.jl:417 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] #runtestitem#65 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 unknown function (ip: 0x71358905a782) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348 unknown function (ip: 0x71358904755d) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 4518378 (Pool: 4518305; Big: 73); GC: 5 ┌ Error: Worker(pid=364, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 371: [ Info: Starting test worker on pid = 371, with 2 threads Worker 371: 12:56:54 | maxrss 2.1% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 371 [371] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x71146fbf7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x71146fbfb1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x71146fc7b85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x71146fbf7f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) _ZNK4llvm10DataLayout12getAlignmentEPNS_4TypeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZNK4llvm11GEPOperator13collectOffsetERKNS_10DataLayoutEjRNS_14SmallMapVectorIPNS_5ValueENS_5APIntELj4EEERS7_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZN4llvm7GVNPass10ValueTable13createGEPExprEPNS_17GetElementPtrInstE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) _ZN4llvm7GVNPass10ValueTable11lookupOrAddEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) ┌ Error: Worker(pid=371, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 378: [ Info: Starting test worker on pid = 378, with 2 threads Worker 378: 12:57:09 | maxrss 2.1% | mem 3.0% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 378 [378] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x7d7fae382f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7d7fae3861c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7d7fae40685b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7d7fae382f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) int64hash at /source/src/support/hashing.c:36 bitmix at /source/src/support/hashing.h:31 [inlined] typekey_hash at /source/src/jltypes.c:1809 [inlined] typekeyvalue_hash at /source/src/jltypes.c:1823 [inlined] lookup_typevalue at /source/src/jltypes.c:1136 lookup_arg_type_tuple at /source/src/gf.c:2859 [inlined] jl_lookup_generic_ at /source/src/gf.c:3920 [inlined] ijl_apply_generic at /source/src/gf.c:3989 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 argtypes_to_type at ./../usr/share/julia/Compiler/src/typeutils.jl:55 handle_call! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1416 assemble_inline_todo! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1664 ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:76 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1033 run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1046 optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1019 jfptr_optimize_83824.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:232 jfptr_finish_nocycle_85624.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4476 typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 jfptr_typeinf_ext_toplevel_84430.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_type_infer at /source/src/gf.c:462 jl_compile_method_internal at /source/src/gf.c:3292 _jl_invoke at /source/src/gf.c:3785 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_f_invokelatest at /source/src/builtins.c:877 _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] jl_f__apply_iterate at /source/src/builtins.c:864 invokelatest at ./Base_compiler.jl:253 _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 Error at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:227 do_test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:771 jfptr_do_test_4583.1 at /opt/julia/share/julia/compiled/v1.13/Test/JfdTE_9HAIE.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 jl_eval_module_expr at /source/src/toplevel.c:196 [inlined] jl_toplevel_eval_flex at /source/src/toplevel.c:658 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 #72 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] with_source_path at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 #70 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 #redirect_stdio#653 at ./stream.jl:1448 redirect_stdio at ./stream.jl:1411 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 #_redirect_logs##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] #open#335 at ./io.jl:420 open at ./io.jl:417 [inlined] _redirect_logs at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] macro expansion at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] #runtestitem#65 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 runtestitem at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 unknown function (ip: 0x7d7f92b231a2) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:708 jl_interpret_toplevel_thunk at /source/src/interpreter.c:899 jl_toplevel_eval_flex at /source/src/toplevel.c:773 ijl_toplevel_eval at /source/src/toplevel.c:785 ijl_toplevel_eval_in at /source/src/toplevel.c:830 eval at ./boot.jl:489 execute at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:334 [inlined] #serve_requests##0 at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/workers.jl:348 unknown function (ip: 0x7d7f92b1553d) at (unknown file) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3159279 (Pool: 3159212; Big: 67); GC: 4 ┌ Error: Worker(pid=378, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 385: [ Info: Starting test worker on pid = 385, with 2 threads Worker 385: 12:57:23 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 385: 12:57:24 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.1 secs (95.1% compile), 7.23 K allocs (372.384 KB) Worker 385: [385] signal 15: Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 385 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 385 ┌ Error: Worker(pid=385, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 392: [ Info: Starting test worker on pid = 392, with 2 threads Worker 392: 12:57:34 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 392: 12:57:35 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" 0.2 secs (95.3% compile), 7.23 K allocs (372.384 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 392 Error in testset "Has retries=4 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails" on Worker(pid=392). Run=3. Worker 392: 12:57:36 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 392: 12:57:36 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.40 K allocs (74.576 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 392 Error in testset "Has retries=4 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails" on Worker(pid=392). Run=4. Worker 392: 12:57:37 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 392: 12:57:37 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.40 K allocs (74.608 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 392 Error in testset "Has retries=4 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails" on Worker(pid=392). Run=5. Worker 392: 12:57:38 | maxrss 2.1% | mem 3.0% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 392: 12:57:38 | maxrss 2.1% | mem 3.0% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.39 K allocs (74.416 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 392 Error in testset "Has retries=4 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:37 Expression: false Worker 392: 12:57:40 | maxrss 2.1% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 392: 12:57:40 | maxrss 2.1% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.40 K allocs (74.752 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 392 Error in testset "Has retries=1 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:43 Expression: false [ Info: Retrying "Has retries=1 and always fails" on Worker(pid=392). Run=2. Worker 392: 12:57:41 | maxrss 2.1% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 392: 12:57:41 | maxrss 2.1% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.39 K allocs (74.416 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 392 Error in testset "Has retries=1 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:43 Expression: false [ Info: Retrying "Has retries=1 and always fails" on Worker(pid=392). Run=3. Worker 392: 12:57:42 | maxrss 2.1% | mem 3.0% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 392: 12:57:42 | maxrss 2.1% | mem 3.0% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.40 K allocs (74.864 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 392 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 392 Error in testset "Has retries=1 and always fails" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:43 Expression: false Worker 392: 12:57:43 | maxrss 2.1% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 392 [392] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x71637a14ef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x71637a1521c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x71637a1d285b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x71637a14ef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=392, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 399: [ Info: Starting test worker on pid = 399, with 2 threads Worker 399: 12:58:01 | maxrss 2.1% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 399 [399] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x723ccf3a9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x723ccf3ad1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x723ccf42d85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x723ccf3a9f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=399, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 406: [ Info: Starting test worker on pid = 406, with 2 threads Worker 406: 12:58:15 | maxrss 2.1% | mem 3.0% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 406 [406] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7ce1d9452f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7ce1d94561c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7ce1d94d685b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7ce1d9452f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) ┌ Error: Worker(pid=406, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 413: [ Info: Starting test worker on pid = 413, with 2 threads Worker 413: 12:58:29 | maxrss 2.1% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 413 [413] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x791b80468f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x791b8046c1c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x791b804ec85b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x791b80468f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x791b80468f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3154842 (Pool: 3154775; Big: 67); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=413, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 420: [ Info: Starting test worker on pid = 420, with 2 threads Worker 420: 12:58:44 | maxrss 2.1% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 420: 12:58:44 | maxrss 2.1% | mem 3.0% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (96.4% compile), 148.50 K allocs (8.324 MB) Worker 420: [420] signal 15: Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 420 ┌ Error: Worker(pid=420, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=3. Worker 427: [ Info: Starting test worker on pid = 427, with 2 threads Worker 427: 12:58:58 | maxrss 2.1% | mem 3.0% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 427: 12:58:58 | maxrss 2.1% | mem 3.0% | DONE (6/6) test item "Timeout first, pass after" 0.3 secs (96.5% compile), 148.50 K allocs (8.325 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=427). Worker 427: [427] signal 15: Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:716 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:716 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:718 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:718 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:721 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 4 == 5 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:721 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:729 Expression: count(contains("num_runs_6"), readdir(tmpdir)) == 2 Evaluated: 3 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:729 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:734 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:705 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:734 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] DEBUG @ ReTestItems.jl:345 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` DEBUG @ ReTestItems.jl:354 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:380 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:382 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 434: [ Info: Starting test worker 1 on pid = 434, with 2 threads [ Info: Starting running test items Worker 434: 12:59:14 | maxrss 2.1% | mem 3.0% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 434 [434] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7e943e724f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7e943e7281c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7e943e7a885b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7e943e724f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7e943e724f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3154942 (Pool: 3154875; Big: 67); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=434, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 441: [ Info: Starting test worker on pid = 441, with 2 threads Worker 441: 12:59:26 | maxrss 2.1% | mem 3.0% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 441: 12:59:27 | maxrss 2.1% | mem 3.0% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (96.3% compile), 21.23 K allocs (1.147 MB) Worker 441: [441] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 441 ┌ Error: Worker(pid=441, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=441, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:715 | Worker 1 closed: Worker(pid=441, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:470 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:474 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:483 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:485 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:774 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:767 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:774 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:766 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1575 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1566 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:767 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:776 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [9] IncludeInto @ ./Base.jl:311 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 DEBUG @ ReTestItems.jl:345 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` DEBUG @ ReTestItems.jl:354 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:380 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:791 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:819 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:382 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 448: [ Info: Starting test worker 1 on pid = 448, with 2 threads [ Info: Starting running test items Worker 448: 12:59:41 | maxrss 2.1% | mem 3.0% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 448 [448] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x748c62415f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x748c624191c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x748c6249985b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x748c62415f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=448, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 455: [ Info: Starting test worker on pid = 455, with 2 threads Worker 455: 12:59:53 | maxrss 2.1% | mem 3.0% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Worker 455: 12:59:54 | maxrss 2.1% | mem 3.0% | DONE (2/2) test item "Test which should run after timeout" 0.2 secs (75.6% compile), 21.23 K allocs (1.147 MB) Worker 455: [455] signal 15: Terminated No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 455 ┌ Error: Worker(pid=455, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=455, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:715 | Worker 1 closed: Worker(pid=455, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:470 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:474 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:483 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:485 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:796 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:787 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:796 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:786 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1575 [inlined] [2] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1566 [3] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:787 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:798 [inlined] [8] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [9] IncludeInto @ ./Base.jl:311 [inlined] [10] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [11] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [12] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [14] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [15] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [16] top-level scope @ none:6 [17] eval(m::Module, e::Any) @ Core ./boot.jl:489 [18] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [19] _start() @ Base ./client.jl:553 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 462: [ Info: Starting test worker 1 on pid = 462, with 2 threads [ Info: Starting running test items Worker 462: 13:00:08 | maxrss 2.1% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 462 [462] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7ff3716bff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x7ff3716c31c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x7ff37174385b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x7ff3716bff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 ┌ Error: Worker(pid=462, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=462, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 469: [ Info: Starting test worker 1 on pid = 469, with 2 threads [ Info: Starting running test items Worker 469: 13:00:23 | maxrss 2.1% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 469 [469] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x751b05342f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x751b053461c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x751b053c685b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x751b05342f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x751b05342f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3156283 (Pool: 3156216; Big: 67); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=469, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=469, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 476: [ Info: Starting test worker 1 on pid = 476, with 2 threads [ Info: Starting running test items Worker 476: 13:00:38 | maxrss 2.1% | mem 3.0% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 476 [476] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x79a0a4edef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 jl_parallel_gc_threadfun at /source/src/gc-stock.c:3654 unknown function (ip: 0x79a0a4ee21c3) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: 0x79a0a4f6285b) at /lib/x86_64-linux-gnu/libc.so.6 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x79a0a4edef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) unknown function (ip: 0x79a0a4edef14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 wait at ./task.jl:1213 wait_forever at ./task.jl:1150 jfptr_wait_forever_54619.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:3793 [inlined] ijl_apply_generic at /source/src/gf.c:3993 jl_apply at /source/src/julia.h:2345 [inlined] start_task at /source/src/task.c:1249 unknown function (ip: (nil)) at (unknown file) Allocations: 3154943 (Pool: 3154876; Big: 67); GC: 4 fatal: error thrown and no exception handler available. Core.InterruptException() ┌ Error: Worker(pid=476, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=476, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.0 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 490: [ Info: Starting test worker 1 on pid = 490, with 3,2 threads [ Info: Starting running test items Worker 490: 13:01:09 | maxrss 2.1% | mem 3.0% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 490: 13:01:10 | maxrss 2.1% | mem 3.0% | DONE (1/1) test item "Was spawned with 3,2 threads" 0.2 secs (95.7% compile, 3.7% recompile), 21.45 K allocs (1.147 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=490). Worker 490: [490] signal 15: Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:874 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:908. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.12 seconds. [ Info: Scheduling 3 tests on pid 89 13:01:13 | maxrss 2.1% | mem 2.2% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.15 K allocs (63.968 KB) 13:01:13 | maxrss 2.1% | mem 2.2% | START (2/3) test item "other A" at test/integrationtests.jl:900 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.32 K allocs (76.432 KB) 13:01:13 | maxrss 2.1% | mem 2.2% | START (3/3) test item "other B" at test/integrationtests.jl:900 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 1 tests on pid 89 13:01:13 | maxrss 2.1% | mem 2.2% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.15 K allocs (63.968 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 13:01:13 | maxrss 2.1% | mem 2.2% | START (1/2) test item "other A" at test/integrationtests.jl:900 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) 13:01:13 | maxrss 2.1% | mem 2.2% | START (2/2) test item "other B" at test/integrationtests.jl:900 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (79.496 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 89 13:01:13 | maxrss 2.1% | mem 2.2% | START (1/1) test item "other B" at test/integrationtests.jl:900 13:01:13 | maxrss 2.1% | mem 2.2% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.32 K allocs (75.072 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.56 seconds. ┌ Warning: No test items found. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:388 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 2 tests on pid 89 13:01:14 | maxrss 2.1% | mem 2.2% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 13:01:14 | maxrss 2.1% | mem 2.2% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) 13:01:14 | maxrss 2.1% | mem 2.2% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 13:01:14 | maxrss 2.1% | mem 2.2% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.08 K allocs (61.664 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 500: [ Info: Starting test worker 1 on pid = 500, with 2 threads [ Info: Starting running test items Worker 500: 13:01:27 | maxrss 2.1% | mem 3.0% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 500: 13:01:28 | maxrss 2.1% | mem 3.0% | DONE (1/2) test item "same name" 0.2 secs (96.3% compile), 21.23 K allocs (1.147 MB) Worker 500: 13:01:29 | maxrss 2.1% | mem 3.0% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 500: 13:01:29 | maxrss 2.1% | mem 3.0% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.09 K allocs (63.248 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=500). Worker 500: [500] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 507: [ Info: Starting test worker 1 on pid = 507, with 2 threads [ Info: Starting running test items Worker 507: [507] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7a9b31e3cf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 507 ┌ Error: Worker(pid=507, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 Worker 514: [ Info: Starting test worker on pid = 514, with 2 threads Worker 514: [514] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x7a2baa45ff14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 514 ┌ Error: Worker(pid=514, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677 [ Info: All tests on worker 1 completed. Closing Worker(pid=514, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 13:07:16 | maxrss 2.1% | mem 2.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) 13:07:16 | maxrss 2.1% | mem 2.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) 13:07:16 | maxrss 2.1% | mem 2.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.19 K allocs (100.528 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 13:07:16 | maxrss 2.1% | mem 2.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 1.70 K allocs (83.344 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 89 Error in testset "happy 1" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 13:07:16 | maxrss 2.1% | mem 2.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.70 K allocs (84.976 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 89 Error in testset "happy 2" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 13:07:16 | maxrss 2.1% | mem 2.2% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 13:07:16 | maxrss 2.1% | mem 2.2% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.70 K allocs (86.456 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 89 Error in testset "happy 3" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 687: [ Info: Starting test worker 1 on pid = 687, with 2 threads [ Info: Starting running test items Worker 687: 13:07:30 | maxrss 2.1% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 687: 13:07:30 | maxrss 2.1% | mem 3.0% | DONE (1/3) test item "happy 1" 0.2 secs (95.2% compile, 3.7% recompile), 21.89 K allocs (1.161 MB) Worker 687: 13:07:31 | maxrss 2.1% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 687: 13:07:31 | maxrss 2.1% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.20 K allocs (101.984 KB) Worker 687: 13:07:32 | maxrss 2.1% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 687: 13:07:32 | maxrss 2.1% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.20 K allocs (100.656 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=687). Worker 687: [687] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 694: [ Info: Starting test worker 1 on pid = 694, with 2 threads [ Info: Starting running test items Worker 694: 13:07:46 | maxrss 2.1% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 694: 13:07:47 | maxrss 2.1% | mem 3.0% | DONE (1/3) test item "happy 1" 0.2 secs (95.7% compile, 3.6% recompile), 21.40 K allocs (1.144 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 694 Error in testset "happy 1" on worker 694: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 694: 13:07:48 | maxrss 2.1% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 694: 13:07:48 | maxrss 2.1% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.71 K allocs (84.928 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 694 Error in testset "happy 2" on worker 694: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 694: 13:07:49 | maxrss 2.1% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 694: 13:07:49 | maxrss 2.1% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.71 K allocs (83.600 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 694 Error in testset "happy 3" on worker 694: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=694). Worker 694: [694] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 701: [ Info: Starting test worker 1 on pid = 701, with 2 threads Worker 703: [ Info: Starting test worker 2 on pid = 703, with 2 threads [ Info: Starting running test items Worker 703: 13:08:17 | maxrss 2.1% | mem 3.7% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 701: 13:08:17 | maxrss 2.1% | mem 3.7% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 703: 13:08:18 | maxrss 2.1% | mem 3.7% | DONE (2/3) test item "happy 2" 0.5 secs (93.5% compile, 3.2% recompile), 21.89 K allocs (1.161 MB) Worker 701: 13:08:18 | maxrss 2.1% | mem 3.7% | DONE (1/3) test item "happy 1" 0.5 secs (96.0% compile, 3.4% recompile), 21.89 K allocs (1.161 MB) Worker 703: 13:08:21 | maxrss 2.1% | mem 3.7% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 703: 13:08:21 | maxrss 2.1% | mem 3.7% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.20 K allocs (102.016 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=701). [ Info: All tests on worker 2 completed. Closing Worker(pid=703). Worker 703: [703] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 715: [ Info: Starting test worker 1 on pid = 715, with 2 threads Worker 717: [ Info: Starting test worker 2 on pid = 717, with 2 threads [ Info: Starting running test items Worker 717: 13:08:51 | maxrss 2.1% | mem 3.8% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 715: 13:08:51 | maxrss 2.1% | mem 3.8% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 717: 13:08:52 | maxrss 2.1% | mem 3.8% | DONE (2/3) test item "happy 2" 0.5 secs (96.5% compile, 4.1% recompile), 21.40 K allocs (1.144 MB) Worker 715: 13:08:52 | maxrss 2.1% | mem 3.8% | DONE (1/3) test item "happy 1" 0.5 secs (97.4% compile, 4.1% recompile), 21.40 K allocs (1.144 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 717 Error in testset "happy 2" on worker 717: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 715 Error in testset "happy 1" on worker 715: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 Worker 717: 13:08:55 | maxrss 2.1% | mem 3.8% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 [ Info: All tests on worker 1 completed. Closing Worker(pid=715). Worker 717: 13:08:55 | maxrss 2.1% | mem 3.8% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.71 K allocs (84.928 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 717 Error in testset "happy 3" on worker 717: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1120 Expression: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=717). Worker 717: [717] signal 15: Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 729: [ Info: Starting test worker 1 on pid = 729, with 2 threads [ Info: Starting running test items Worker 729: 13:09:11 | maxrss 2.1% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 729: 13:09:11 | maxrss 2.1% | mem 3.0% | DONE (1/3) test item "happy 1" 0.3 secs (96.3% compile, 3.6% recompile), 21.89 K allocs (1.172 MB) Worker 729: 13:09:12 | maxrss 2.1% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 729: 13:09:12 | maxrss 2.1% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.61 K allocs (81.424 KB) Worker 729: 13:09:13 | maxrss 2.1% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 729: 13:09:13 | maxrss 2.1% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.61 K allocs (80.096 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=729). Worker 729: [729] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1143 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 16.7s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1143 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 3 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 736: [ Info: Starting test worker 1 on pid = 736, with 2 threads [ Info: Starting running test items Worker 736: 13:09:27 | maxrss 2.1% | mem 3.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 736: 13:09:28 | maxrss 2.1% | mem 3.0% | DONE (1/3) test item "happy 1" 0.4 secs (96.3% compile, 2.2% recompile), 55.41 K allocs (3.008 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 736 Error in testset "post-testitem" on worker 736: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false Worker 736: 13:09:30 | maxrss 2.1% | mem 3.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 736: 13:09:30 | maxrss 2.1% | mem 3.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 3.23 K allocs (137.704 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 736 Error in testset "post-testitem" on worker 736: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false Worker 736: 13:09:31 | maxrss 2.1% | mem 3.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 736: 13:09:31 | maxrss 2.1% | mem 3.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 3.23 K allocs (136.344 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 736 Error in testset "post-testitem" on worker 736: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1154 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=736). Worker 736: [736] signal 15: Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1165 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 18.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1165 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1172 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 18.4s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 0.4s\n post-testitem | 1 1 0.0s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1100 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1131 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1172 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Activating project at `~/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1226 [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 743: [ Info: Starting test worker 1 on pid = 743, with 2 threads [ Info: Starting running test items Worker 743: 13:09:47 | maxrss 2.2% | mem 3.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 743: 13:09:47 | maxrss 2.2% | mem 3.0% | DONE (1/2) test item "correct usage" 0.4 secs (97.8% compile, 2.6% recompile), 68.82 K allocs (3.785 MB) Worker 743: 13:09:48 | maxrss 2.2% | mem 3.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 743: 13:09:48 | maxrss 2.2% | mem 3.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (81.0% compile), 2.47 K allocs (132.288 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=743). [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. [ Info: Scheduling 2 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 750: [ Info: Starting test worker 1 on pid = 750, with 2 threads [ Info: Starting running test items Worker 750: 13:10:03 | maxrss 2.2% | mem 3.0% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 750: 13:10:04 | maxrss 2.2% | mem 3.0% | DONE (1/2) test item "correct usage" 0.7 secs (97.5% compile, 1.2% recompile), 279.13 K allocs (15.334 MB) Worker 750: 13:10:05 | maxrss 2.2% | mem 3.0% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 750: 13:10:05 | maxrss 2.2% | mem 3.0% | DONE (2/2) test item "incorrect usage" <0.1 secs (57.2% compile), 5.12 K allocs (230.216 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 750 Error in testset "no pins left at end of test" on worker 750: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1198 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=750). Worker 750: [750] signal 15: Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. [ Info: Scheduling 9 tests on pid 89 13:10:07 | maxrss 2.2% | mem 2.2% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (1/9) test item "do_thing Pass" <0.1 secs (83.5% compile), 8.76 K allocs (503.200 KB) 13:10:07 | maxrss 2.2% | mem 2.2% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.21 K allocs (107.584 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 89 [ Info: RUNNING Error in testset "do_thing Fail" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.814032664109667, 0.5519857785101333, 0.33292211303917296] == 1 13:10:07 | maxrss 2.2% | mem 2.2% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (3/9) test item "do_thing Error" 0.1 secs (<0.1% compile), 52.88 K allocs (7.517 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 89 [ Info: RUNNING Error in testset "do_thing Error" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array The function `+` exists, but no method is defined for this combination of argument types. Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:643 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:316 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/src/do_thing_tests.jl:8 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] 13:10:07 | maxrss 2.2% | mem 2.2% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (4/9) test item "bad setup, good test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 89 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 89 Error in testset "bad setup, good test" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [28] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [29] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [31] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [36] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [38] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [45] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [46] IncludeInto @ ./Base.jl:311 [inlined] [47] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [48] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [49] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [50] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [51] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [52] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [53] top-level scope @ none:6 [54] eval(m::Module, e::Any) @ Core ./boot.jl:489 [55] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 13:10:07 | maxrss 2.2% | mem 2.2% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (5/9) test item "bad setup, bad test" <0.1 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 89 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 89 Error in testset "bad setup, bad test" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_in_setup_test.jl:3 [9] eval(m::Module, e::Any) @ Core ./boot.jl:489 [10] #ensure_setup!##4 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [11] with_source_path(f::ReTestItems.var"#ensure_setup!##4#ensure_setup!##5"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [12] #ensure_setup!##2 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:963 [inlined] [13] redirect_stdio(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [14] redirect_stdio @ ./stream.jl:1411 [inlined] [15] _redirect_logs(f::ReTestItems.var"#ensure_setup!##2#ensure_setup!##3"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [16] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:962 [inlined] [17] macro expansion @ ./lock.jl:376 [inlined] [18] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:937 [19] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1073 [20] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [21] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [22] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [23] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [24] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [25] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [26] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [27] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [28] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [29] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [31] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [36] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [38] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [40] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [41] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [42] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [45] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [46] IncludeInto @ ./Base.jl:311 [inlined] [47] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [48] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [49] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [50] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [51] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [52] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [53] top-level scope @ none:6 [54] eval(m::Module, e::Any) @ Core ./boot.jl:489 [55] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 13:10:07 | maxrss 2.2% | mem 2.2% | START (6/9) test item "errors" at test/error_tests.jl:1 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (6/9) test item "errors" <0.1 secs (<0.1% compile), 26.69 K allocs (1.868 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 89 [ Info: RUNNING Error in testset "UndefVarError" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined in `Main.var"##errors#910"` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "UndefVarError" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined in `Main.var"##errors#910"` Suggestion: check for spelling errors or missing imports. Hint: LinearAlgebra is loaded but not imported in the active module Main. Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:3 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:738 [inlined] Error in testset "evaluated to non-Boolean" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:2377 [inlined] [2] macro expansion @ ./lock.jl:376 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:2360 [4] require @ ./loading.jl:2336 [inlined] [5] eval_import_path @ ./module.jl:36 [inlined] [6] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:60 [7] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [8] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [11] eval(m::Module, e::Any) @ Core ./boot.jl:489 [12] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [13] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [14] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [15] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [16] redirect_stdio @ ./stream.jl:1411 [inlined] [17] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [18] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [19] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [20] open @ ./io.jl:417 [inlined] [21] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [22] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [23] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [24] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [25] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [26] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [27] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [28] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [29] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [30] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [31] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [32] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [33] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [35] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [40] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [42] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [50] IncludeInto @ ./Base.jl:311 [inlined] [51] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [52] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [53] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [55] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [56] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [57] top-level scope @ none:6 [58] eval(m::Module, e::Any) @ Core ./boot.jl:489 [59] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 13:10:07 | maxrss 2.2% | mem 2.2% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (7/9) test item "errors at the top level" <0.1 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 89 [ Info: RUNNING Error in testset "errors at the top level" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval(m::Module, e::Any) @ Core ./boot.jl:489 [3] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [4] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [5] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [6] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [7] redirect_stdio @ ./stream.jl:1411 [inlined] [8] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [9] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [11] open @ ./io.jl:417 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [15] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [17] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [18] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [19] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [22] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [23] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [24] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [26] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [31] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [33] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [40] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [41] IncludeInto @ ./Base.jl:311 [inlined] [42] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [43] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [44] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [47] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [48] top-level scope @ none:6 [49] eval(m::Module, e::Any) @ Core ./boot.jl:489 [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 13:10:07 | maxrss 2.2% | mem 2.2% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (8/9) test item "nonexistent test setup" <0.1 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 89 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 89: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined in `Main` Suggestion: check for spelling errors or missing imports. Stacktrace: [1] eval_import_path_all(at::Module, path::Expr, keyword::String) @ Base ./module.jl:62 [2] _eval_using(to::Module, path::Expr) @ Base ./module.jl:137 [3] top-level scope @ none:0 [4] eval(m::Module, e::Any) @ Core ./boot.jl:489 [5] #72 @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [inlined] [6] with_source_path(f::ReTestItems.var"#72#73"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:925 [7] (::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1107 [8] redirect_stdio(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1448 [9] redirect_stdio @ ./stream.jl:1411 [inlined] [10] _redirect_logs(f::ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:124 [11] #_redirect_logs##0 @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#_redirect_logs##0#_redirect_logs##1"{ReTestItems.var"#70#71"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:420 [13] open @ ./io.jl:417 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1104 [17] runtestitem @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:1026 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:409 [19] (::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:365 [20] with_logstate(f::ReTestItems.var"#_runtests##0#_runtests##1"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [21] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:348 [23] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:318 [24] runtests @ ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:241 [inlined] [25] #576 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1220 [inlined] [26] #with_test_package##4 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#with_test_package##4#with_test_package##5"{var"#576#577"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:1403 [28] #with_test_package##2 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#with_test_package##2#with_test_package##3"{var"#576#577"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #with_test_package##0 @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [33] encased_testset(f::var"#with_test_package##0#with_test_package##1"{var"#576#577"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#576#577"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:31 [35] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1211 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1219 [inlined] [42] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [43] IncludeInto @ ./Base.jl:311 [inlined] [44] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [45] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [46] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [48] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [49] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [50] top-level scope @ none:6 [51] eval(m::Module, e::Any) @ Core ./boot.jl:489 [52] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 13:10:07 | maxrss 2.2% | mem 2.2% | START (9/9) test item "failures" at test/failure_tests.jl:1 13:10:07 | maxrss 2.2% | mem 2.2% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 3.41 K allocs (156.736 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 89 [ Info: RUNNING Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.2952186906554431 < 0 Error in testset "failures" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 0.4s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.0s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.1s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.0s bad setup, bad test | 1 1 0.0s test/error_tests.jl | 1 6 7 errors | 4 4 0.1s UndefVarError | 2 2 0.0s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.0s errors at the top level | 1 1 2 0.0s nonexistent test setup | 1 1 0.0s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1239. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1239 overwritten at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1270. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 6 tests on pid 89 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 820: [ Info: Starting test worker 1 on pid = 820, with 2 threads [ Info: Starting running test items Worker 820: 13:12:31 | maxrss 2.2% | mem 3.0% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 820: 13:12:32 | maxrss 2.2% | mem 3.0% | DONE (1/6) test item "no skip, 1 pass" 0.2 secs (92.4% compile), 21.23 K allocs (1.147 MB) Worker 820: 13:12:33 | maxrss 2.2% | mem 3.0% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 820: 13:12:33 | maxrss 2.2% | mem 3.0% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.49 K allocs (78.288 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 820 Error in testset "skip false, 1 pass, 1 fail" on worker 820: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_skip_tests.jl:8 Expression: false Worker 820: 13:12:34 | maxrss 2.2% | mem 3.0% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 820: 13:12:35 | maxrss 2.2% | mem 3.0% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 820: 13:12:35 | maxrss 2.2% | mem 3.0% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.49 K allocs (76.880 KB) Worker 820: 13:12:36 | maxrss 2.2% | mem 3.0% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 No Captured Logs for test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 on worker 820 ┌ Error: Worker(pid=820, terminated=true, termsignal=-2147483648) died running test item "skip expr block true". Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:683 [ Info: All tests on worker 1 completed. Closing Worker(pid=820, terminated=true, termsignal=-2147483648). Worker 820: [820] signal 15: Terminated in expression starting at none:1 unknown function (ip: 0x755d96538f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 skipping testitems: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1278 Got exception outside of a @test MethodError: no method matching print_test_results(::Error) The function `print_test_results` exists, but no method is defined for this combination of argument types. Closest candidates are: print_test_results(!Matched::Test.AbstractTestSet) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1261 print_test_results(!Matched::Test.AbstractTestSet, !Matched::Any) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1261 Stacktrace: [1] (::var"#596#597"{Error})() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1284 [2] (::IOCapture.var"#12#13"{Type{Any}, var"#596#597"{Error}, IOContext{Base.PipeEndpoint}, IOContext{Base.PipeEndpoint}, Base.PipeEndpoint, Base.PipeEndpoint})() @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:170 [3] with_logstate(f::IOCapture.var"#12#13"{Type{Any}, var"#596#597"{Error}, IOContext{Base.PipeEndpoint}, IOContext{Base.PipeEndpoint}, Base.PipeEndpoint, Base.PipeEndpoint}, logstate::Base.CoreLogging.LogState) @ Base.CoreLogging ./logging/logging.jl:540 [4] with_logger(f::Function, logger::Base.CoreLogging.ConsoleLogger) @ Base.CoreLogging ./logging/logging.jl:651 [5] capture(f::var"#596#597"{Error}; rethrow::Type, color::Bool, passthrough::Bool, capture_buffer::IOBuffer, io_context::Vector{Any}) @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:167 [6] capture(f::Function) @ IOCapture ~/.julia/packages/IOCapture/Y5rEA/src/IOCapture.jl:100 [7] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1280 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [11] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1283 [inlined] [12] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [13] IncludeInto @ ./Base.jl:311 [inlined] [14] (::var"#5#6")() @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:21 [15] withenv(f::var"#5#6", keyvals::Pair{String, Int64}) @ Base ./env.jl:265 [16] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:15 [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [18] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:17 [inlined] [19] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:310 [20] top-level scope @ none:6 [21] eval(m::Module, e::Any) @ Core ./boot.jl:489 [22] exec_options(opts::Base.JLOptions) @ Base ./client.jl:286 [23] _start() @ Base ./client.jl:553 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_parse_error_test.jl 13:12:49 | maxrss 2.2% | mem 2.9% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:6 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] Test Summary: | Fail Total Time should fail | 1 1 8.1s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_direct_testitem.jl:5 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.05 seconds.\n[ Info: Scheduling 3 tests on pid 89 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 890: [ Info: Starting test worker 3 on pid = 890, with 2 threads\n Worker 889: [ Info: Starting test worker 2 on pid = 889, with 2 threads\n Worker 887: [ Info: Starting test worker 1 on pid = 887, with 2 threads\n[ Info: Starting running test items\n Worker 889: [889] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x753a5bdc3f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 890: [890] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x752f36c8cf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 887: [887] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7387ce57af14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 887\n┌ Error: Worker(pid=887, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 889\n┌ Error: Worker(pid=889, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 890\n┌ Error: Worker(pid=890, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 912: [ Info: Starting test worker on pid = 912, with 2 threads\n Worker 910: [ Info: Starting test worker on pid = 910, with 2 threads\n Worker 908: [ Info: Starting test worker on pid = 908, with 2 threads\n Worker 912: [912] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7376c854bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 910: [910] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x726062095f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 908: [908] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7fdc0eac0f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 912\n┌ Error: Worker(pid=912, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=912, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 910\n┌ Error: Worker(pid=910, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 2 completed. Closing Worker(pid=910, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 908\n┌ Error: Worker(pid=908, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 1 completed. Closing Worker(pid=908, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.44 seconds.\n[ Info: Scheduling 3 tests on pid 89 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 943: [ Info: Starting test worker 1 on pid = 943, with 2 threads\n Worker 946: [ Info: Starting test worker 3 on pid = 946, with 2 threads\n Worker 945: [ Info: Starting test worker 2 on pid = 945, with 2 threads\n[ Info: Starting running test items\n Worker 943: [943] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7a0a21c7bf14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 945: [945] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x772fe32f7f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 946: [946] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x77970c908f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 943\n┌ Error: Worker(pid=943, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\n\nNo Captured LogsNo Captured Logs for test item \"bad\" at for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:4test/testfiles/_failfast_timeout_tests.jl:9 on worker 945\n┌ Error: Worker(pid=945, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n on worker 946[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\n┌ Error: Worker(pid=946, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n Worker 966: [ Info: Starting test worker on pid = 966, with 2 threads\n Worker 964: [ Info: Starting test worker on pid = 964, with 2 threads\n Worker 965: [ Info: Starting test worker on pid = 965, with 2 threads\n Worker 966: [966] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x739d4faf6f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 964: [964] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x72043fe98f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n Worker 965: [965] signal 15: Terminated\nin expression starting at none:1\nunknown function (ip: 0x7097e5457f14) at /lib/x86_64-linux-gnu/libc.so.6\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 964\n┌ Error: Worker(pid=964, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=964, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 966\n┌ Error: Worker(pid=966, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 3 completed. Closing Worker(pid=966, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 965\n┌ Error: Worker(pid=965, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/RVvCj/src/ReTestItems.jl:677\n[ Info: All tests on worker 2 completed. Closing Worker(pid=965, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1389 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:47 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [3] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1353 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1855 [inlined] [5] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1355 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1367 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1944 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/RVvCj/test/integrationtests.jl:1380 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:741 [inlined] [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 1 tests on pid 89 13:19:52 | maxrss 2.2% | mem 2.2% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 13:19:52 | maxrss 2.2% | mem 2.2% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 89 Error in testset "test set" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. [ Info: Scheduling 2 tests on pid 89 13:19:55 | maxrss 2.2% | mem 2.2% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 13:19:55 | maxrss 2.2% | mem 2.2% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 89 Error in testset "Failure at toplevel" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 13:19:55 | maxrss 2.2% | mem 2.2% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 13:19:55 | maxrss 2.2% | mem 2.2% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 89 Error in testset "Bar" on worker 89: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. [ Tests Completed: 0/0 test items were run. 13:20:10 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 13:20:10 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" 0.2 secs (98.7% compile), 109.61 K allocs (6.705 MB) 13:20:11 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 13:20:11 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" <0.1 secs (77.6% compile), 1.72 K allocs (239.088 KB) 13:20:11 | maxrss 2.3% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 13:20:12 | maxrss 2.3% | mem 3.1% | DONE test item "uses printstyled" 0.8 secs (99.7% compile), 405.72 K allocs (23.466 MB) 13:20:12 | maxrss 2.3% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 13:20:12 | maxrss 2.3% | mem 3.1% | DONE test item "uses @error" 0.3 secs (97.1% compile), 30.64 K allocs (1.866 MB) 13:20:13 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 13:20:13 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @info" 0.4 secs (97.0% compile), 37.42 K allocs (2.172 MB) 13:20:13 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 13:20:13 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (76.2% compile), 9.72 K allocs (611.320 KB) 13:20:14 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 13:20:14 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stdout" 0.2 secs (96.0% compile), 38.20 K allocs (2.321 MB) 13:20:14 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 13:20:14 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (96.1% compile), 36.60 K allocs (2.238 MB) 13:20:15 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 13:20:15 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (96.3% compile), 135.66 K allocs (7.900 MB) 13:20:15 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 13:20:15 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (90.1% compile), 14.40 K allocs (1.002 MB) 13:20:15 | maxrss 2.3% | mem 3.1% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 13:20:16 | maxrss 2.3% | mem 3.1% | DONE test item "uses display" 0.5 secs (99.6% compile), 232.92 K allocs (13.216 MB) 13:20:17 | maxrss 2.3% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:184 13:20:17 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 812 allocs (53.424 KB) 13:20:17 | maxrss 2.3% | mem 3.2% | START test item "setup uses println" at _test_log_capture.jl:199 13:20:17 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses println" <0.1 secs, 813 allocs (55.056 KB) 13:20:18 | maxrss 2.3% | mem 3.2% | START test item "setup uses printstyled" at _test_log_capture.jl:214 13:20:18 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses printstyled" <0.1 secs, 814 allocs (54.160 KB) 13:20:18 | maxrss 2.3% | mem 3.2% | START test item "setup uses @error" at _test_log_capture.jl:229 13:20:18 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses @error" <0.1 secs, 812 allocs (53.424 KB) 13:20:18 | maxrss 2.3% | mem 3.2% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 13:20:18 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.43 K allocs (76.992 KB) 13:20:18 | maxrss 2.3% | mem 3.2% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 13:20:18 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.43 K allocs (76.992 KB) 13:20:19 | maxrss 2.3% | mem 3.2% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 13:20:19 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.42 K allocs (76.816 KB) 13:20:19 | maxrss 2.3% | mem 3.2% | START test item "setup uses with_logger" at _test_log_capture.jl:315 13:20:19 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses with_logger" <0.1 secs, 812 allocs (53.424 KB) 13:20:19 | maxrss 2.3% | mem 3.2% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 13:20:19 | maxrss 2.3% | mem 3.2% | DONE test item "setup uses display" <0.1 secs, 812 allocs (53.424 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 13.9s 13:20:31 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 13:20:31 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" <0.1 secs (93.4% compile), 22.41 K allocs (1.268 MB) 13:20:31 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 13:20:31 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" <0.1 secs (73.8% compile), 823 allocs (55.664 KB) 13:20:31 | maxrss 2.3% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 13:20:31 | maxrss 2.3% | mem 3.1% | DONE test item "uses printstyled" <0.1 secs (81.2% compile), 4.01 K allocs (251.424 KB) 13:20:31 | maxrss 2.3% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 13:20:32 | maxrss 2.3% | mem 3.1% | DONE test item "uses @error" 0.2 secs (97.1% compile), 19.29 K allocs (1.110 MB) 13:20:32 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 13:20:32 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @info" 0.4 secs (96.8% compile), 37.47 K allocs (2.175 MB) 13:20:32 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 13:20:32 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (75.8% compile), 9.76 K allocs (613.768 KB) 13:20:32 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 13:20:33 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stdout" 0.5 secs (98.4% compile, 64.8% GC), 38.24 K allocs (2.323 MB) 13:20:33 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 13:20:33 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (93.0% compile), 36.64 K allocs (2.240 MB) 13:20:33 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 13:20:33 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (96.5% compile), 135.70 K allocs (7.903 MB) 13:20:33 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 13:20:33 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (89.0% compile), 10.58 K allocs (664.488 KB) 13:20:33 | maxrss 2.3% | mem 3.1% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 13:20:34 | maxrss 2.3% | mem 3.1% | DONE test item "uses display" 1.4 secs (99.8% compile), 647.35 K allocs (36.963 MB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:184 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 855 allocs (55.744 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:199 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 856 allocs (57.376 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses printstyled" at _test_log_capture.jl:214 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses printstyled" <0.1 secs, 857 allocs (56.512 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses @error" at _test_log_capture.jl:229 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses @error" <0.1 secs, 855 allocs (55.744 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 13:20:35 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 13:20:35 | maxrss 2.3% | mem 3.1% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 13:20:36 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.46 K allocs (79.296 KB) 13:20:36 | maxrss 2.3% | mem 3.1% | START test item "setup uses with_logger" at _test_log_capture.jl:315 13:20:36 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses with_logger" <0.1 secs, 855 allocs (55.776 KB) 13:20:36 | maxrss 2.3% | mem 3.1% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 13:20:36 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses display" <0.1 secs, 855 allocs (55.744 KB) Test Summary: | Pass Broken Total Time log capture logs=:batched |  26  2  28 8.2s 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:8 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" <0.1 secs (92.3% compile), 22.41 K allocs (1.268 MB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses println" at _test_log_capture.jl:21 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses println" <0.1 secs (75.0% compile), 823 allocs (55.664 KB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses printstyled" at _test_log_capture.jl:34 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses printstyled" <0.1 secs (79.5% compile), 4.01 K allocs (251.424 KB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses @error" at _test_log_capture.jl:47 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses @error" 0.2 secs (97.0% compile), 19.29 K allocs (1.110 MB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @info" 0.3 secs (96.8% compile), 37.47 K allocs (2.175 MB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 13:20:46 | maxrss 2.3% | mem 3.1% | DONE test item "uses @test_logs @error" <0.1 secs (76.6% compile), 9.76 K allocs (613.704 KB) 13:20:46 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 13:20:47 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stdout" 0.5 secs (98.8% compile, 68.5% GC), 38.24 K allocs (2.323 MB) 13:20:47 | maxrss 2.3% | mem 3.1% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 13:20:47 | maxrss 2.3% | mem 3.1% | DONE test item "uses redirect_stderr" 0.2 secs (95.9% compile), 36.64 K allocs (2.240 MB) 13:20:47 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 13:20:47 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger (redirect to a file)" 0.3 secs (96.4% compile), 135.70 K allocs (7.902 MB) 13:20:47 | maxrss 2.3% | mem 3.1% | START test item "uses with_logger" at _test_log_capture.jl:149 13:20:47 | maxrss 2.3% | mem 3.1% | DONE test item "uses with_logger" <0.1 secs (88.5% compile), 10.58 K allocs (664.488 KB) 13:20:47 | maxrss 2.3% | mem 3.1% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 13:20:49 | maxrss 2.3% | mem 3.1% | DONE test item "uses display" 1.3 secs (99.8% compile), 647.35 K allocs (36.962 MB) 13:20:49 | maxrss 2.3% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:184 13:20:49 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 855 allocs (55.744 KB) 13:20:49 | maxrss 2.3% | mem 3.1% | START test item "setup uses println" at _test_log_capture.jl:199 13:20:49 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses println" <0.1 secs, 856 allocs (57.376 KB) 13:20:49 | maxrss 2.3% | mem 3.1% | START test item "setup uses printstyled" at _test_log_capture.jl:214 13:20:49 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses printstyled" <0.1 secs, 857 allocs (56.512 KB) 13:20:49 | maxrss 2.3% | mem 3.1% | START test item "setup uses @error" at _test_log_capture.jl:229 13:20:49 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses @error" <0.1 secs, 855 allocs (55.744 KB) 13:20:49 | maxrss 2.3% | mem 3.1% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 13:20:50 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 13:20:50 | maxrss 2.3% | mem 3.1% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 13:20:50 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.47 K allocs (79.360 KB) 13:20:50 | maxrss 2.3% | mem 3.1% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 13:20:50 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.46 K allocs (79.296 KB) 13:20:50 | maxrss 2.3% | mem 3.1% | START test item "setup uses with_logger" at _test_log_capture.jl:315 13:20:50 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses with_logger" <0.1 secs, 855 allocs (55.776 KB) 13:20:50 | maxrss 2.3% | mem 3.1% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 13:20:50 | maxrss 2.3% | mem 3.1% | DONE test item "setup uses display" <0.1 secs, 855 allocs (55.744 KB) Test Summary: | Pass Broken Total Time log capture logs=:issues |  26  2  28 6.8s ┌ Warning: Skipping JUnit XML reference tests on unrelease Julia version │ VERSION = v"1.13.0-DEV.843" └ @ Main ~/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:31 Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 1607 27 9 3 1646 39m31.3s workers.jl | 35 5 40 1m11.7s correct connected/running states (Worker(pid=93)) | 7 7 0.5s clean shutdown (Worker(pid=93)) | 6 6 2.4s more forceful shutdown (Worker(pid=98)) | 7 7 0.4s remote_eval/remote_fetch (Worker(pid=103)) | 5 5 5.2s worker crashing (Worker(pid=108)) | 7 7 2.6s remote_eval (Worker(pid=113)) | 2 2 3.7s CPU profile | 1 5 6 23.2s internals.jl | 416 1 5 422 18.0s get_starting_testitems | 300 300 3.5s is_test_file | 20 20 0.0s is_testsetup_file | 5 5 0.0s _is_subproject | 7 7 0.1s include_testfiles! | 4 1 5 9.0s only requested testfiles included | 1 1 6.0s testsetup files always included | 4 4 3.0s report_empty_testsets | 6 6 1.1s JUnit _error_message | 2 2 0.1s _validated_nworker_threads | 19 19 0.1s _validated_paths | 13 13 0.3s skiptestitem | 4 4 0.8s should_skip | 3 1 4 8 2.6s filtering.jl | 21 21 0.3s nestedrelpath | 12 12 0.0s macros.jl | 75 1 76 12.2s testsetup macro basic | 1 1 0.0s testitem macro basic | 4 4 2.9s testitem with `tags` | 3 3 0.2s testitem with `retries` | 3 3 0.2s testitem with macro import | 2 2 1.7s testitem with `setup` | 5 5 0.8s testsetup and testitem with includes | 3 3 0.2s missing testsetup | 1 1 0.4s testitem with duplicate keywords | 1 1 0.5s can identity if in a `@testitem` | 2 2 0.0s testitem macro runs immediately outside `runtests` | 6 6 1.2s manually specify `source` location | 4 4 0.0s testsetup not given module | 2 2 1.7s testitem `_id` keyword | 6 6 1.3s testitem `timeout` keyword | 8 8 0.6s testitem `skip` keyword | 11 1 12 0.2s tesitem `failfast` keyword | 2 2 0.1s testitem with `default_imports` | 6 6 0.2s testitem with unrecognised keyword | 1 1 0.0s testitem without a body | 4 4 0.0s integrationtests.jl | 380 21 3 3 407 36m15.8s manual `runtests(dir)` | 2 2 14.5s manual `runtests(file)` | 2 2 0.3s `runtests(path)` auto finds testsetups | 3 3 3.6s Warn or error when not test file | 11 11 4.4s filter `runtests(func, x)` | 12 1 13 14.2s `@testitem` scoping rules | 1 1 0.2s single-process | 12 2 1 15 3m24.4s Pkg.test() NoDeps.jl | 1 1 28.2s Pkg.test() TestsInSrc.jl | 1 1 24.6s Pkg.test() TestProjectFile.jl | 1 1 46.4s Pkg.test() TestEndExpr.jl | 1 1 1m00.2s Pkg.test() DontPass.jl | 1 1 38.1s runtests() NoDeps.jl | 2 2 0.2s runtests() TestsInSrc.jl | 2 2 0.1s runtests() TestProjectFile.jl | 2 2 3.2s runtests() TestEndExpr.jl | 1 1 0.0s runtests() DontPass.jl | 3 3 3.3s runtests a dir with 0 nworkers but worker_init_expr set | 2 2 0.7s runtests with nworkers = 2 | 10 10 5m55.1s Pkg.test() NoDeps.jl | 2 2 1m06.8s Pkg.test() TestsInSrc.jl | 2 2 1m16.3s Pkg.test() TestProjectFile.jl | 2 2 1m03.2s Pkg.test() TestEndExpr.jl | 2 2 49.4s Pkg.test() DontPass.jl | 2 2 1m39.4s don't recurse into subpackages | 2 2 3.7s trigger subpackage tests | 3 3 27.2s passing file (not dir) | 1 1 0.2s passing multiple files/dirs | 4 4 4.0s print report sorted | 2 2 1.1s `verbose_results`, `debug` and `logs` keywords | 48 48 1.2s `report=true` is not compatible with `logs=:eager` | 1 1 0.2s filter `runtests(x; tags)` | 8 8 9.1s filter `runtests(x; name)` | 7 7 5.4s filter `runtests(x; name, tags)` | 7 7 6.9s filter `runtests(func, x; name, tags)` | 8 8 12.2s Warn on empty test set -- integration test | 3 3 0.1s log capture for an errored TestSetup | 2 2 4 23.1s test crashing testitem | 4 4 29.6s test retrying failing testitem | 3 5 8 3m16.2s bugfix: `runtests` in a testset | 2 2 1.2s testitem_timeout | 1 1 1 3 26.7s testitem_timeout set via env variable | 1 1 1 3 27.5s @testitem `timeout` | 12 12 45.8s Error outside `@testitem` | 2 2 0.0s `runtests` finds no testitems | 2 2 0.1s Worker log capture on a failing test is not reported twice | 1 1 15.3s Worker and nworker_threads argument | 1 1 14.8s _redirect_logs and custom loggers | 1 1 0.4s error on code outside `@testitem`/`@testsetup` | 10 10 2.6s Duplicate names in same file throws | 2 2 0.1s Duplicate names in different files allowed | 2 2 15.6s Duplicate IDs not allowed | 2 2 0.0s Timeout failures accurately record elapsed time | 1 1 24.2s CPU profile timeout trigger | 16 16 3m22.0s worker always crashes immediately | 4 4 1m03.0s worker crashes immediately but succeeds on retry | 3 3 56.8s test_end_expr | 21 3 24 2m50.9s nworkers=0 | 5 5 0.8s nworkers=1 | 5 5 33.7s nworkers=2 | 5 5 1m07.1s report printing | 2 3 5 35.7s TestEndExpr.jl package | 4 4 33.5s test_end_expr always runs, even if testitem throws | 2 2 0.6s Replace workers when we hit memory threshold | 7 7 2m06.9s skipping testitems | 1 1 24.0s logs are aligned | 3 3 0.5s ParseError in test file | 2 2 1.4s invalid testitem combined with filter function | 24 24 0.5s error code from running `@testitem` directly | 1 1 17.4s runtests `failfast` keyword | 62 6 2 70 6m54.1s failure | 17 1 18 1m28.9s nworkers=0 | 6 6 0.5s nworkers=1 | 6 6 17.0s nworkers=3 | 5 1 6 1m11.4s error | 16 2 18 1m31.0s nworkers=0 | 6 6 0.6s nworkers=1 | 6 6 20.2s nworkers=3 | 4 2 6 1m10.2s timeout | 10 2 1 13 1m45.0s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 34.0s nworkers=3 | 4 2 6 1m10.9s crash | 11 1 1 13 1m36.8s nworkers=0 | 1 1 0.0s nworkers=1 | 6 6 28.4s nworkers=3 | 5 1 6 1m08.4s multiple failures | 5 5 31.8s ENV var | 3 3 0.5s Handle `@testset failfast=true` | 3 3 0.2s DONE time reported when testitem throws | 2 2 0.9s runtests `testitem_failfast` keyword | 27 27 3.4s `test_end_expr` must be `:block` | 1 1 0.2s warn if no test items | 4 4 1.1s log_capture.jl | 52 52 1m14.5s log capture | 3 3 53.2s Workers print in color | 1 1 20.5s log capture -- reporting | 12 12 0.2s default_log_display_mode | 20 20 0.0s print_time | 16 16 0.6s tests removed workers | 648 648 0.0s RNG of the outermost testset: Random.Xoshiro(0x8f15289ae9eb1410, 0x722dbf42cacb1bbd, 0x8475c62bfe0a9631, 0x0db5fcd20783a9e3, 0xdbe52efd751afb71) ERROR: LoadError: Some tests did not pass: 1607 passed, 27 failed, 9 errored, 3 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/RVvCj/test/runtests.jl:13 Testing failed after 2328.75s ERROR: LoadError: Package ReTestItems errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2446 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2301 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:500 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:164 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:152 [7] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:152 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:151 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [10] include(mod::Module, _path::String) @ Base ./Base.jl:309 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:320 [12] _start() @ Base ./client.jl:553 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 2456.97s: package is using an unknown package