Package evaluation of ReTestItems on Julia 1.10.9 (96dc2d8c45*) started at 2025-06-06T12:06:24.203 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 6.16s ################################################################################ # Installation # Installing ReTestItems... Resolving package versions... Updating `~/.julia/environments/v1.10/Project.toml` [817f1d60] + ReTestItems v1.31.0 Updating `~/.julia/environments/v1.10/Manifest.toml` [817f1d60] + ReTestItems v1.31.0 [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [56ddb016] + Logging [d6f4376e] + Markdown [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 Installation completed after 4.32s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 11.62s ################################################################################ # Testing # Testing ReTestItems Status `/tmp/jl_ppfhuO/Project.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [b5f81e59] IOCapture v0.2.5 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [ade2ca70] Dates [56ddb016] Logging [44cfe95a] Pkg v1.10.0 [9abbd945] Profile [9a3f8284] Random [9e88b42a] Serialization [6462fe0b] Sockets [8dfed614] Test Status `/tmp/jl_ppfhuO/Manifest.toml` [15f4f7f2] AutoHashEquals v2.2.0 [ab62b9b5] DeepDiffs v1.2.0 [8f5d6c58] EzXML v1.2.1 [b5f81e59] IOCapture v0.2.5 [c8e1da08] IterTools v1.10.0 [692b3bcd] JLLWrappers v1.7.0 [bac558e1] OrderedCollections v1.8.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 [1e6cf692] TestEnv v1.102.1 [228000da] XMLDict v0.4.1 [94ce4f54] Libiconv_jll v1.18.0+0 ⌅ [02c8fc9c] XML2_jll v2.13.6+1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [9abbd945] Profile [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Worker 18: [18] signal (15): Terminated in expression starting at none:1 Worker 21: [21] signal (15): Terminated Worker 27: [27] signal (15): Terminated CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:110 Expression: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 1 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 30: ======================================================================================\n Worker 30: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 30: ======================================================================================\n Worker 30: cmd: /opt/julia/bin/julia 30 running 1 of 5\n Worker 30: signal (10): User defined signal 1\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: _trywait at ./asyncevent.jl:142\n Worker 30: wait at ./asyncevent.jl:159 [inlined]\n Worker 30: profile_printing_listener at ./Base.jl:572\n Worker 30: #1058 at ./Base.jl:608\n Worker 30: jfptr_YY.1058_85318.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: start_task at /source/src/task.c:1256\n Worker 30: unknown function (ip: (nil))\n Worker 30: _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_12MachineInstrEjNS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_jEEEES3_jS5_S8_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-15jl.so (unknown line)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: epoll_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv__io_poll at /workspace/srcdir/libuv/src/unix/epoll.c:236\n Worker 30: uv_run at /workspace/srcdir/libuv/src/unix/core.c:400\n Worker 30: ijl_task_get_next at /source/src/partr.c:478\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: wait_readnb at ./stream.jl:416\n Worker 30: eof at ./stream.jl:106\n Worker 30: read at ./stream.jl:980\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:814 [inlined]\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:801\n Worker 30: serve_requests at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:340\n Worker 30: startworker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:310\n Worker 30: unknown function (ip: 0x725a88b895a2)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: do_call at /source/src/interpreter.c:126\n Worker 30: eval_value at /source/src/interpreter.c:223\n Worker 30: eval_stmt_value at /source/src/interpreter.c:174 [inlined]\n Worker 30: eval_body at /source/src/interpreter.c:635\n Worker 30: jl_interpret_toplevel_thunk at /source/src/interpreter.c:775\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:934\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: ijl_toplevel_eval_in at /source/src/toplevel.c:985\n Worker 30: eval at ./boot.jl:385 [inlined]\n Worker 30: exec_options at ./client.jl:296\n Worker 30: _start at ./client.jl:557\n Worker 30: jfptr__start_83099.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: true_main at /source/src/jlapi.c:582\n Worker 30: jl_repl_entrypoint at /source/src/jlapi.c:731\n Worker 30: main at /source/cli/loader_exe.c:58\n Worker 30: unknown function (ip: 0x725a899d0249)\n Worker 30: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: unknown function (ip: 0x4010b8)\n Worker 30: unknown function (ip: (nil))\n Worker 30: ==============================================================\n Worker 30: Profile collected. A report will print at the next yield point\n Worker 30: ==============================================================\n Worker 30: [30] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x725a89a2ef14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:110 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:98 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:7 CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:111 Expression: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 2 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 30: ======================================================================================\n Worker 30: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 30: ======================================================================================\n Worker 30: cmd: /opt/julia/bin/julia 30 running 1 of 5\n Worker 30: signal (10): User defined signal 1\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: _trywait at ./asyncevent.jl:142\n Worker 30: wait at ./asyncevent.jl:159 [inlined]\n Worker 30: profile_printing_listener at ./Base.jl:572\n Worker 30: #1058 at ./Base.jl:608\n Worker 30: jfptr_YY.1058_85318.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: start_task at /source/src/task.c:1256\n Worker 30: unknown function (ip: (nil))\n Worker 30: _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_12MachineInstrEjNS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_jEEEES3_jS5_S8_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-15jl.so (unknown line)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: epoll_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv__io_poll at /workspace/srcdir/libuv/src/unix/epoll.c:236\n Worker 30: uv_run at /workspace/srcdir/libuv/src/unix/core.c:400\n Worker 30: ijl_task_get_next at /source/src/partr.c:478\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: wait_readnb at ./stream.jl:416\n Worker 30: eof at ./stream.jl:106\n Worker 30: read at ./stream.jl:980\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:814 [inlined]\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:801\n Worker 30: serve_requests at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:340\n Worker 30: startworker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:310\n Worker 30: unknown function (ip: 0x725a88b895a2)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: do_call at /source/src/interpreter.c:126\n Worker 30: eval_value at /source/src/interpreter.c:223\n Worker 30: eval_stmt_value at /source/src/interpreter.c:174 [inlined]\n Worker 30: eval_body at /source/src/interpreter.c:635\n Worker 30: jl_interpret_toplevel_thunk at /source/src/interpreter.c:775\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:934\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: ijl_toplevel_eval_in at /source/src/toplevel.c:985\n Worker 30: eval at ./boot.jl:385 [inlined]\n Worker 30: exec_options at ./client.jl:296\n Worker 30: _start at ./client.jl:557\n Worker 30: jfptr__start_83099.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: true_main at /source/src/jlapi.c:582\n Worker 30: jl_repl_entrypoint at /source/src/jlapi.c:731\n Worker 30: main at /source/cli/loader_exe.c:58\n Worker 30: unknown function (ip: 0x725a899d0249)\n Worker 30: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: unknown function (ip: 0x4010b8)\n Worker 30: unknown function (ip: (nil))\n Worker 30: ==============================================================\n Worker 30: Profile collected. A report will print at the next yield point\n Worker 30: ==============================================================\n Worker 30: [30] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x725a89a2ef14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:111 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:98 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:7 CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:112 Expression: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 3 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 30: ======================================================================================\n Worker 30: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 30: ======================================================================================\n Worker 30: cmd: /opt/julia/bin/julia 30 running 1 of 5\n Worker 30: signal (10): User defined signal 1\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: _trywait at ./asyncevent.jl:142\n Worker 30: wait at ./asyncevent.jl:159 [inlined]\n Worker 30: profile_printing_listener at ./Base.jl:572\n Worker 30: #1058 at ./Base.jl:608\n Worker 30: jfptr_YY.1058_85318.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: start_task at /source/src/task.c:1256\n Worker 30: unknown function (ip: (nil))\n Worker 30: _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_12MachineInstrEjNS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_jEEEES3_jS5_S8_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-15jl.so (unknown line)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: epoll_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv__io_poll at /workspace/srcdir/libuv/src/unix/epoll.c:236\n Worker 30: uv_run at /workspace/srcdir/libuv/src/unix/core.c:400\n Worker 30: ijl_task_get_next at /source/src/partr.c:478\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: wait_readnb at ./stream.jl:416\n Worker 30: eof at ./stream.jl:106\n Worker 30: read at ./stream.jl:980\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:814 [inlined]\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:801\n Worker 30: serve_requests at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:340\n Worker 30: startworker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:310\n Worker 30: unknown function (ip: 0x725a88b895a2)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: do_call at /source/src/interpreter.c:126\n Worker 30: eval_value at /source/src/interpreter.c:223\n Worker 30: eval_stmt_value at /source/src/interpreter.c:174 [inlined]\n Worker 30: eval_body at /source/src/interpreter.c:635\n Worker 30: jl_interpret_toplevel_thunk at /source/src/interpreter.c:775\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:934\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: ijl_toplevel_eval_in at /source/src/toplevel.c:985\n Worker 30: eval at ./boot.jl:385 [inlined]\n Worker 30: exec_options at ./client.jl:296\n Worker 30: _start at ./client.jl:557\n Worker 30: jfptr__start_83099.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: true_main at /source/src/jlapi.c:582\n Worker 30: jl_repl_entrypoint at /source/src/jlapi.c:731\n Worker 30: main at /source/cli/loader_exe.c:58\n Worker 30: unknown function (ip: 0x725a899d0249)\n Worker 30: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: unknown function (ip: 0x4010b8)\n Worker 30: unknown function (ip: (nil))\n Worker 30: ==============================================================\n Worker 30: Profile collected. A report will print at the next yield point\n Worker 30: ==============================================================\n Worker 30: [30] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x725a89a2ef14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:112 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:98 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:7 CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:114 Expression: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 4 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 30: ======================================================================================\n Worker 30: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 30: ======================================================================================\n Worker 30: cmd: /opt/julia/bin/julia 30 running 1 of 5\n Worker 30: signal (10): User defined signal 1\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: _trywait at ./asyncevent.jl:142\n Worker 30: wait at ./asyncevent.jl:159 [inlined]\n Worker 30: profile_printing_listener at ./Base.jl:572\n Worker 30: #1058 at ./Base.jl:608\n Worker 30: jfptr_YY.1058_85318.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: start_task at /source/src/task.c:1256\n Worker 30: unknown function (ip: (nil))\n Worker 30: _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_12MachineInstrEjNS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_jEEEES3_jS5_S8_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-15jl.so (unknown line)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: epoll_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv__io_poll at /workspace/srcdir/libuv/src/unix/epoll.c:236\n Worker 30: uv_run at /workspace/srcdir/libuv/src/unix/core.c:400\n Worker 30: ijl_task_get_next at /source/src/partr.c:478\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: wait_readnb at ./stream.jl:416\n Worker 30: eof at ./stream.jl:106\n Worker 30: read at ./stream.jl:980\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:814 [inlined]\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:801\n Worker 30: serve_requests at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:340\n Worker 30: startworker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:310\n Worker 30: unknown function (ip: 0x725a88b895a2)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: do_call at /source/src/interpreter.c:126\n Worker 30: eval_value at /source/src/interpreter.c:223\n Worker 30: eval_stmt_value at /source/src/interpreter.c:174 [inlined]\n Worker 30: eval_body at /source/src/interpreter.c:635\n Worker 30: jl_interpret_toplevel_thunk at /source/src/interpreter.c:775\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:934\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: ijl_toplevel_eval_in at /source/src/toplevel.c:985\n Worker 30: eval at ./boot.jl:385 [inlined]\n Worker 30: exec_options at ./client.jl:296\n Worker 30: _start at ./client.jl:557\n Worker 30: jfptr__start_83099.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: true_main at /source/src/jlapi.c:582\n Worker 30: jl_repl_entrypoint at /source/src/jlapi.c:731\n Worker 30: main at /source/cli/loader_exe.c:58\n Worker 30: unknown function (ip: 0x725a899d0249)\n Worker 30: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: unknown function (ip: 0x4010b8)\n Worker 30: unknown function (ip: (nil))\n Worker 30: ==============================================================\n Worker 30: Profile collected. A report will print at the next yield point\n Worker 30: ==============================================================\n Worker 30: [30] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x725a89a2ef14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:114 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:98 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:7 CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:115 Expression: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", logs) Evaluated: occursin(r"Thread 5 Task 0x\w+ Total snapshots: \d+. Utilization: \d+%", " Worker 30: ======================================================================================\n Worker 30: Information request received. A stacktrace will print followed by a 1.0 second profile\n Worker 30: ======================================================================================\n Worker 30: cmd: /opt/julia/bin/julia 30 running 1 of 5\n Worker 30: signal (10): User defined signal 1\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: _trywait at ./asyncevent.jl:142\n Worker 30: wait at ./asyncevent.jl:159 [inlined]\n Worker 30: profile_printing_listener at ./Base.jl:572\n Worker 30: #1058 at ./Base.jl:608\n Worker 30: jfptr_YY.1058_85318.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: start_task at /source/src/task.c:1256\n Worker 30: unknown function (ip: (nil))\n Worker 30: _ZN4llvm12DenseMapBaseINS_8DenseMapIPNS_12MachineInstrEjNS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_jEEEES3_jS5_S8_E16FindAndConstructERKS3_ at /opt/julia/bin/../lib/julia/libLLVM-15jl.so (unknown line)\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: (nil))\n Worker 30: unknown function (ip: 0x725a89a2ef14)\n Worker 30: pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\n Worker 30: ijl_task_get_next at /source/src/partr.c:517\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: task_done_hook at ./task.jl:682\n Worker 30: jfptr_task_done_hook_75433.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: jl_finish_task at /source/src/task.c:327\n Worker 30: jl_threadfun at /source/src/partr.c:199\n Worker 30: unknown function (ip: 0x725a89a321c3)\n Worker 30: unknown function (ip: 0x725a89ab285b)\n Worker 30: unknown function (ip: (nil))\n Worker 30: epoll_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: uv__io_poll at /workspace/srcdir/libuv/src/unix/epoll.c:236\n Worker 30: uv_run at /workspace/srcdir/libuv/src/unix/core.c:400\n Worker 30: ijl_task_get_next at /source/src/partr.c:478\n Worker 30: poptask at ./task.jl:999\n Worker 30: wait at ./task.jl:1008\n Worker 30: #wait#647 at ./condition.jl:130\n Worker 30: wait at ./condition.jl:125 [inlined]\n Worker 30: wait_readnb at ./stream.jl:416\n Worker 30: eof at ./stream.jl:106\n Worker 30: read at ./stream.jl:980\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:814 [inlined]\n Worker 30: deserialize at /source/usr/share/julia/stdlib/v1.10/Serialization/src/Serialization.jl:801\n Worker 30: serve_requests at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:340\n Worker 30: startworker at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:310\n Worker 30: unknown function (ip: 0x725a88b895a2)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: do_call at /source/src/interpreter.c:126\n Worker 30: eval_value at /source/src/interpreter.c:223\n Worker 30: eval_stmt_value at /source/src/interpreter.c:174 [inlined]\n Worker 30: eval_body at /source/src/interpreter.c:635\n Worker 30: jl_interpret_toplevel_thunk at /source/src/interpreter.c:775\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:934\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: jl_toplevel_eval_flex at /source/src/toplevel.c:877\n Worker 30: ijl_toplevel_eval_in at /source/src/toplevel.c:985\n Worker 30: eval at ./boot.jl:385 [inlined]\n Worker 30: exec_options at ./client.jl:296\n Worker 30: _start at ./client.jl:557\n Worker 30: jfptr__start_83099.1 at /opt/julia/lib/julia/sys.so (unknown line)\n Worker 30: _jl_invoke at /source/src/gf.c:2876 [inlined]\n Worker 30: ijl_apply_generic at /source/src/gf.c:3077\n Worker 30: jl_apply at /source/src/julia.h:1982 [inlined]\n Worker 30: true_main at /source/src/jlapi.c:582\n Worker 30: jl_repl_entrypoint at /source/src/jlapi.c:731\n Worker 30: main at /source/cli/loader_exe.c:58\n Worker 30: unknown function (ip: 0x725a899d0249)\n Worker 30: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\n Worker 30: unknown function (ip: 0x4010b8)\n Worker 30: unknown function (ip: (nil))\n Worker 30: ==============================================================\n Worker 30: Profile collected. A report will print at the next yield point\n Worker 30: ==============================================================\n Worker 30: [30] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x725a89a2ef14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:115 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:98 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/workers.jl:7 ┌ Warning: Test item "Dummy TestItem" at source/path:42 contains test sets without tests: │ "Empty testset" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:328 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: No such path "foo" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 ┌ Warning: "/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file.jl" is not a test file └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:125 12:07:59 | maxrss 1.2% | mem 1.3% | SKIP (0/1) test item "skip" at internals.jl:288 12:08:03 | maxrss 1.2% | mem 1.3% | START test item "TI1" at macros.jl:32 12:08:03 | maxrss 1.2% | mem 1.3% | DONE test item "TI1" <0.1 secs (94.3% compile), 34.41 K allocs (2.591 MB) 12:08:03 | maxrss 1.2% | mem 1.3% | START test item "TI2" at macros.jl:43 12:08:03 | maxrss 1.2% | mem 1.3% | DONE test item "TI2" <0.1 secs (<0.1% compile), 1.27 K allocs (91.744 KB) 12:08:03 | maxrss 1.2% | mem 1.3% | START test item "TI" at macros.jl:53 12:08:03 | maxrss 1.2% | mem 1.3% | DONE test item "TI" <0.1 secs (<0.1% compile), 1.27 K allocs (91.744 KB) 12:08:03 | maxrss 1.2% | mem 1.3% | START test item "macro-import" at macros.jl:64 12:08:05 | maxrss 1.2% | mem 1.3% | DONE test item "macro-import" 1.4 secs (99.1% compile, 11.3% GC), 427.13 K allocs (31.291 MB) 12:08:05 | maxrss 1.2% | mem 1.3% | START test item "Foo" at macros.jl:95 12:08:05 | maxrss 1.2% | mem 1.3% | DONE test item "Foo" <0.1 secs (<0.1% compile), 2.27 K allocs (151.656 KB) 12:08:05 | maxrss 1.2% | mem 1.3% | START test item "Foo3" at macros.jl:110 12:08:06 | maxrss 1.2% | mem 1.3% | DONE test item "Foo3" <0.1 secs (56.3% compile), 2.32 K allocs (159.784 KB) 12:08:06 | maxrss 1.2% | mem 1.3% | START test item "Foo4" at macros.jl:119 Foo4: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:119 Got exception outside of a @test UndefVarError: `NonExistentSetup` not defined Stacktrace: [1] eval @ ./boot.jl:385 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::Base.PipeEndpoint) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:109 [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [7] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Nothing, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [8] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [9] runtestitem(ti::TestItem; kw::@Kwargs{finish_test::Bool}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1007 [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:123 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:118 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:23 [15] include @ ./client.jl:494 [inlined] [16] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:20 [17] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [18] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [20] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [21] include(fname::String) @ Base.MainInclude ./client.jl:494 [22] top-level scope @ none:6 [23] eval @ ./boot.jl:385 [inlined] [24] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [25] _start() @ Base ./client.jl:557 12:08:08 | maxrss 1.5% | mem 1.5% | DONE test item "Foo4" 12:08:08 | maxrss 1.5% | mem 1.5% | START test item "testitem active" at macros.jl:138 12:08:08 | maxrss 1.5% | mem 1.5% | DONE test item "testitem active" <0.1 secs (83.8% compile), 2.42 K allocs (173.584 KB) 12:08:08 | maxrss 1.5% | mem 1.5% | START test item "run" at macros.jl:146 12:08:08 | maxrss 1.5% | mem 1.5% | DONE test item "run" <0.1 secs (<0.1% compile), 1.27 K allocs (91.744 KB) 12:08:09 | maxrss 1.5% | mem 1.5% | START test item "comparisons" at macros.jl:182 12:08:09 | maxrss 1.6% | mem 1.5% | DONE test item "comparisons" 0.1 secs (81.3% compile), 8.05 K allocs (769.248 KB) 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa bool" at macros.jl:306 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "test contains error" at macros.jl:314 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 1" at macros.jl:335 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip isa expr 2" at macros.jl:345 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr loads module" at macros.jl:362 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 12:08:12 | maxrss 1.6% | mem 1.6% | SKIP test item "skip expr defines variable" at macros.jl:371 12:08:12 | maxrss 1.6% | mem 1.6% | START test item "default_imports" at macros.jl:424 12:08:12 | maxrss 1.6% | mem 1.6% | DONE test item "default_imports" <0.1 secs (55.1% compile), 1.58 K allocs (107.632 KB) 12:08:12 | maxrss 1.6% | mem 1.6% | START test item "no_default_imports" at macros.jl:432 12:08:12 | maxrss 1.6% | mem 1.6% | DONE test item "no_default_imports" <0.1 secs (<0.1% compile), 826 allocs (47.024 KB) WARNING: Method definition n_passed(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/macros.jl:7 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:69. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` Updating `~/.julia/packages/ReTestItems/Q6zs8/Project.toml` [1e6cf692] + TestEnv v1.102.1 [44cfe95a] ~ Pkg ⇒ v1.10.0 Updating `~/.julia/packages/ReTestItems/Q6zs8/Manifest.toml` [1e6cf692] + TestEnv v1.102.1 [0dad84c5] + ArgTools v1.1.1 [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [f43a241f] + Downloads v1.6.0 [7b1f6079] + FileWatching [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL v0.6.4 [76f85450] + LibGit2 [8f399da3] + Libdl [56ddb016] + Logging [d6f4376e] + Markdown [ca575930] + NetworkOptions v1.2.0 [44cfe95a] + Pkg v1.10.0 [de0858da] + Printf [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization [6462fe0b] + Sockets [fa267f1f] + TOML v1.0.3 [a4e569a6] + Tar v1.10.0 [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [deac9b47] + LibCURL_jll v8.4.0+0 [e37daf67] + LibGit2_jll v1.6.4+0 [29816b5a] + LibSSH2_jll v1.11.0+1 [c8ffd9c3] + MbedTLS_jll v2.28.2+1 [14a3606d] + MozillaCACerts_jll v2023.1.10 [83775a58] + Zlib_jll v1.2.13+1 [8e850ede] + nghttp2_jll v1.52.0+1 [3f19e933] + p7zip_jll v17.4.0+2 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:08:41 | maxrss 1.7% | mem 1.7% | START (1/1) test item "foo" at test/testfiles/_testitem_test.jl:2 12:08:41 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.59 K allocs (118.456 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested/_testitem_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:08:41 | maxrss 1.7% | mem 1.7% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 12:08:41 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.52 K allocs (112.208 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nested [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:08:41 | maxrss 1.7% | mem 1.7% | START (1/1) test item "foo" at test/testfiles/_nested/_testitem_test.jl:2 12:08:41 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "foo" <0.1 secs (<0.1% compile), 1.52 K allocs (112.208 KB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` 12:08:43 | maxrss 1.7% | mem 1.7% | START (1/1) test item "foo" at src/foo_test.jl:1 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "foo" 0.6 secs (3.2% compile), 5.68 K allocs (472.440 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 12 12:08:44 | maxrss 1.7% | mem 1.7% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.29 K allocs (146.200 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:08:44 | maxrss 1.7% | mem 1.7% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:08:44 | maxrss 1.7% | mem 1.7% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:08:45 | maxrss 1.7% | mem 1.7% | DONE (7/8) test item "bar" 0.5 secs (96.8% compile), 250.69 K allocs (15.028 MB) 12:08:45 | maxrss 1.7% | mem 1.7% | START (8/8) test item "foo" at src/foo_test.jl:1 12:08:45 | maxrss 1.7% | mem 1.7% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.74 K allocs (117.160 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.59 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.58 seconds. Scheduling 1 tests on pid 12 12:08:47 | maxrss 1.7% | mem 1.7% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:08:47 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.58 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.63 seconds. Scheduling 1 tests on pid 12 12:08:48 | maxrss 1.7% | mem 1.7% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 12:08:48 | maxrss 1.7% | mem 1.7% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.65 seconds. Scheduling 1 tests on pid 12 12:08:49 | maxrss 1.8% | mem 1.8% | START (1/1) test item "b" at src/b_dir/b_test.jl:1 12:08:49 | maxrss 1.8% | mem 1.8% | DONE (1/1) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.64 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.64 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_scope_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 5 tests on pid 12 12:08:53 | maxrss 1.8% | mem 1.8% | START (1/5) test item "scope test - loops" at test/testfiles/_scope_tests.jl:4 12:08:53 | maxrss 1.8% | mem 1.8% | DONE (1/5) test item "scope test - loops" <0.1 secs (72.2% compile), 3.07 K allocs (211.920 KB) 12:08:53 | maxrss 1.8% | mem 1.8% | START (2/5) test item "scope test - setups" at test/testfiles/_scope_tests.jl:18 12:08:53 | maxrss 1.8% | mem 1.8% | DONE (2/5) test item "scope test - setups" <0.1 secs (71.2% compile), 3.26 K allocs (227.904 KB) 12:08:53 | maxrss 1.8% | mem 1.8% | START (3/5) test item "scope test - testsets" at test/testfiles/_scope_tests.jl:27 12:08:53 | maxrss 1.8% | mem 1.8% | DONE (3/5) test item "scope test - testsets" <0.1 secs (62.4% compile), 3.77 K allocs (248.032 KB) 12:08:53 | maxrss 1.8% | mem 1.8% | START (4/5) test item "scope test - imports" at test/testfiles/_scope_tests.jl:38 12:08:53 | maxrss 1.8% | mem 1.8% | DONE (4/5) test item "scope test - imports" <0.1 secs (72.9% compile), 6.16 K allocs (405.936 KB) 12:08:53 | maxrss 1.8% | mem 1.8% | START (5/5) test item "scope test - consts" at test/testfiles/_scope_tests.jl:57 12:08:53 | maxrss 1.8% | mem 1.8% | DONE (5/5) test item "scope test - consts" <0.1 secs (<0.1% compile), 2.14 K allocs (139.056 KB) [ Tests Completed: 5/5 test items were run. ┌ Warning: The active manifest file has dependencies that were resolved with a different julia version (1.8.2). Unexpected behavior may occur. └ @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/Manifest.toml:0 Testing NoDeps ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_OUvuQN/Project.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test Status `/tmp/jl_OUvuQN/Manifest.toml` [2520ce14] NoDeps v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 3.55 seconds. Scheduling 2 tests on pid 45 12:09:11 | maxrss 1.8% | mem 2.3% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 12:09:12 | maxrss 1.8% | mem 2.3% | DONE (1/2) test item "toplevel" 0.9 secs (98.8% compile), 29.51 K allocs (1.940 MB) 12:09:12 | maxrss 1.8% | mem 2.3% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 12:09:13 | maxrss 1.8% | mem 2.3% | DONE (2/2) test item "NoDeps-testitem" 0.7 secs (97.8% compile, 5.0% GC), 29.04 K allocs (2.031 MB) Captured Logs for test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 on worker 45 NoDeps tests done! [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time NoDeps | 2 2 3.5s . | 1 1 toplevel_tests.jl | 1 1 toplevel | 1 1 0.9s test | 1 1 test/NoDeps_tests.jl | 1 1 NoDeps-testitem | 1 1 0.7s inner-testset | 1 1 0.3s Testing NoDeps tests passed Testing TestsInSrc ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_GpNgF7/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [8dfed614] Test Status `/tmp/jl_GpNgF7/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [3520ce14] TestsInSrc v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 3.58 seconds. Scheduling 8 tests on pid 49 12:09:29 | maxrss 1.8% | mem 2.3% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (1/8) test item "a1" 0.9 secs (98.6% compile), 29.98 K allocs (1.992 MB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (2/8) test item "a2" 0.3 secs (95.8% compile), 25.82 K allocs (1.861 MB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.30 K allocs (93.648 KB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.30 K allocs (93.648 KB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.30 K allocs (93.648 KB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:09:30 | maxrss 1.8% | mem 2.3% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.30 K allocs (93.648 KB) 12:09:30 | maxrss 1.8% | mem 2.3% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:09:31 | maxrss 1.8% | mem 2.3% | DONE (7/8) test item "bar" 0.8 secs (97.7% compile), 253.58 K allocs (15.180 MB) 12:09:31 | maxrss 1.8% | mem 2.3% | START (8/8) test item "foo" at src/foo_test.jl:1 12:09:31 | maxrss 1.8% | mem 2.3% | DONE (8/8) test item "foo" <0.1 secs (71.5% compile), 2.75 K allocs (189.208 KB) [ Tests Completed: 8/8 test items were run. Test Summary: | Pass Total Time TestsInSrc | 13 13 4.1s src | 13 13 src/a_dir | 6 6 src/a_dir/a1_test.jl | 1 1 a1 | 1 1 0.9s src/a_dir/a2_test.jl | 2 2 a2 | 2 2 0.3s a2_testset | 1 1 0.1s src/a_dir/x_dir | 3 3 src/a_dir/x_dir/x_test.jl | 3 3 z | 1 1 0.0s y | 1 1 0.0s x | 1 1 0.0s src/b_dir | 1 1 src/b_dir/b_test.jl | 1 1 b | 1 1 0.0s src/bar_tests.jl | 4 4 bar | 4 4 0.8s bar values | 2 2 0.1s src/foo_test.jl | 2 2 foo | 2 2 0.0s Testing TestsInSrc tests passed Testing TestProjectFile ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_EXNdQK/Project.toml` ⌅ [842dd82b] InlineStrings v1.0.0 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [8dfed614] Test Status `/tmp/jl_EXNdQK/Manifest.toml` [7876af07] Example v0.5.5 ⌅ [842dd82b] InlineStrings v1.0.0 [69de0a69] Parsers v2.8.3 ⌅ [aea7be01] PrecompileTools v1.2.1 [21216c6a] Preferences v1.4.3 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [7770ce14] TestProjectFile v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 3.52 seconds. Scheduling 1 tests on pid 53 12:09:48 | maxrss 1.8% | mem 2.3% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 12:09:51 | maxrss 1.8% | mem 2.4% | DONE (1/1) test item "TestProjectFile" 2.7 secs (57.6% compile), 138.05 K allocs (9.967 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time TestProjectFile | 1 1 4.6s test | 1 1 test/TestProjectFile-test.jl | 1 1 TestProjectFile | 1 1 2.7s test-only dep on InlineStrings | 1 1 1.7s Testing TestProjectFile tests passed Testing TestEndExpr Status `/tmp/jl_88wDkx/Project.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [8dfed614] Test Status `/tmp/jl_88wDkx/Manifest.toml` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [4560ce14] TestEndExpr v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` ⌃ [1e6cf692] TestEnv v1.100.1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Info Packages marked with ⌃ have new versions available and may be upgradable. Testing Running tests... [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 3.36 seconds. Scheduling 2 tests on pid 63 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 75: [ Info: Starting test worker 1 on pid = 75, with 2 threads [ Info: Starting running test items Worker 75: 12:10:29 | maxrss 1.1% | mem 3.1% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 75: 12:10:31 | maxrss 1.1% | mem 3.1% | DONE (1/2) test item "correct usage" 1.2 secs (98.9% compile), 38.76 K allocs (2.579 MB) Worker 75: 12:10:33 | maxrss 1.1% | mem 3.1% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 75: 12:10:33 | maxrss 1.1% | mem 3.1% | DONE (2/2) test item "incorrect usage" <0.1 secs (62.5% compile), 2.12 K allocs (152.840 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=75). Worker 75: [75] signal (15): Terminated [ Tests Completed: 2/2 test items were run. Test Summary: | Pass Total Time TestEndExpr | 2 2 24.5s Testing TestEndExpr tests passed Testing DontPass ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_Ys8vcY/Project.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [37e2e46d] LinearAlgebra [8dfed614] Test Status `/tmp/jl_Ys8vcY/Manifest.toml` [550ce164] DontPass v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [37e2e46d] LinearAlgebra [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [e66e0078] CompilerSupportLibraries_jll v1.1.1+0 [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [4536629a] OpenBLAS_jll v0.3.23+4 [83775a58] Zlib_jll v1.2.13+1 [8e850b90] libblastrampoline_jll v5.11.0+0 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 4.25 seconds. Scheduling 9 tests on pid 79 12:10:52 | maxrss 1.8% | mem 2.4% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 12:10:53 | maxrss 1.8% | mem 2.4% | DONE (1/9) test item "do_thing Pass" 1.6 secs (99.4% compile), 243.13 K allocs (14.296 MB) 12:10:53 | maxrss 1.8% | mem 2.4% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 12:10:54 | maxrss 1.8% | mem 2.5% | DONE (2/9) test item "do_thing Fail" 0.3 secs (96.6% compile), 72.04 K allocs (5.456 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 79 Error in testset "do_thing Fail" on worker 79: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.17056047528038543, 0.2672298443967157, 0.9205561630866071] == 1 12:10:55 | maxrss 1.8% | mem 2.5% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 12:10:59 | maxrss 1.8% | mem 2.7% | DONE (3/9) test item "do_thing Error" 3.9 secs (84.7% compile, 0.4% GC), 741.00 K allocs (58.127 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 79 Error in testset "do_thing Error" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:587 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:319 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 12:10:59 | maxrss 1.8% | mem 2.7% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 12:10:59 | maxrss 1.8% | mem 2.7% | DONE (4/9) test item "bad setup, good test" 0.7 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 79 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 79 Error in testset "bad setup, good test" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Base.MainInclude ./client.jl:494 [30] top-level scope @ none:6 [31] eval @ ./boot.jl:385 [inlined] [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [33] _start() @ Base ./client.jl:557 12:10:59 | maxrss 1.8% | mem 2.7% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 12:11:00 | maxrss 1.8% | mem 2.7% | DONE (5/9) test item "bad setup, bad test" 0.3 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 79 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 79 Error in testset "bad setup, bad test" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [27] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [28] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [29] include(fname::String) @ Base.MainInclude ./client.jl:494 [30] top-level scope @ none:6 [31] eval @ ./boot.jl:385 [inlined] [32] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [33] _start() @ Base ./client.jl:557 12:11:00 | maxrss 1.8% | mem 2.7% | START (6/9) test item "errors" at test/error_tests.jl:1 12:11:01 | maxrss 1.8% | mem 2.7% | DONE (6/9) test item "errors" 1.5 secs (46.7% compile), 106.30 K allocs (7.833 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 79 Error in testset "UndefVarError" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:385 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [15] redirect_stdio @ ./stream.jl:1376 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [19] open @ ./io.jl:393 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [26] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [27] with_logger @ ./logging.jl:630 [inlined] [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [32] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [33] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [34] include(fname::String) @ Base.MainInclude ./client.jl:494 [35] top-level scope @ none:6 [36] eval @ ./boot.jl:385 [inlined] [37] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [38] _start() @ Base ./client.jl:557 12:11:01 | maxrss 1.8% | mem 2.7% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 12:11:02 | maxrss 1.8% | mem 2.7% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 79 Error in testset "errors at the top level" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:385 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [7] redirect_stdio @ ./stream.jl:1376 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [11] open @ ./io.jl:393 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [18] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [19] with_logger @ ./logging.jl:630 [inlined] [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [24] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [25] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [26] include(fname::String) @ Base.MainInclude ./client.jl:494 [27] top-level scope @ none:6 [28] eval @ ./boot.jl:385 [inlined] [29] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [30] _start() @ Base ./client.jl:557 12:11:02 | maxrss 1.8% | mem 2.7% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 12:11:02 | maxrss 1.8% | mem 2.7% | DONE (8/9) test item "nonexistent test setup" 0.2 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 79 Error in testset "nonexistent test setup" on worker 79: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined Stacktrace: [1] eval @ ./boot.jl:385 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [6] redirect_stdio @ ./stream.jl:1376 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [10] open @ ./io.jl:393 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:345 [17] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [18] with_logger @ ./logging.jl:630 [inlined] [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] #runtests#48 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:242 [inlined] [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:239 [inlined] [23] #runtests#47 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:238 [inlined] [24] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [25] include(fname::String) @ Base.MainInclude ./client.jl:494 [26] top-level scope @ none:6 [27] eval @ ./boot.jl:385 [inlined] [28] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [29] _start() @ Base ./client.jl:557 12:11:02 | maxrss 1.8% | mem 2.7% | START (9/9) test item "failures" at test/failure_tests.jl:1 12:11:02 | maxrss 1.8% | mem 2.7% | DONE (9/9) test item "failures" <0.1 secs (82.3% compile), 10.63 K allocs (702.368 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 79 Error in testset "failures" on worker 79: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 79: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.5757991903590737 < 0 Error in testset "failures" on worker 79: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 12.8s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 1.6s do_thing Fail | 1 1 0.3s do_thing Error | 1 1 3.9s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.7s bad setup, bad test | 1 1 0.3s test/error_tests.jl | 1 6 7 errors | 4 4 1.7s UndefVarError | 2 2 0.7s evaluated to non-Boolean | 1 1 0.1s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.4s nonexistent test setup | 1 1 0.2s test/failure_tests.jl | 3 3 failures | 3 3 0.1s ERROR: LoadError: Some tests did not pass: 2 passed, 4 failed, 9 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/runtests.jl:2 [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:11:04 | maxrss 1.8% | mem 1.8% | START (1/2) test item "toplevel" at toplevel_tests.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (1/2) test item "toplevel" <0.1 secs (<0.1% compile), 1.35 K allocs (98.032 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (2/2) test item "NoDeps-testitem" at test/NoDeps_tests.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (2/2) test item "NoDeps-testitem" <0.1 secs (<0.1% compile), 2.15 K allocs (139.632 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 12 12:11:04 | maxrss 1.8% | mem 1.8% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.29 K allocs (146.200 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) 12:11:04 | maxrss 1.8% | mem 1.8% | START (8/8) test item "foo" at src/foo_test.jl:1 12:11:04 | maxrss 1.8% | mem 1.8% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.74 K allocs (117.160 KB) [ Tests Completed: 8/8 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.9/activate_set.jl:63 [ Info: Scanning for test items in project `TestProjectFile` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:11:04 | maxrss 1.8% | mem 1.8% | START (1/1) test item "TestProjectFile" at test/TestProjectFile-test.jl:1 12:11:04 | maxrss 1.8% | mem 1.9% | DONE (1/1) test item "TestProjectFile" 0.3 secs (55.4% compile, 44.3% recompile), 77.34 K allocs (5.629 MB) [ Tests Completed: 1/1 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.9/activate_set.jl:63 [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 9 tests on pid 12 12:11:05 | maxrss 1.8% | mem 1.9% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 12:11:05 | maxrss 1.8% | mem 1.9% | DONE (1/9) test item "do_thing Pass" <0.1 secs (67.6% compile), 7.60 K allocs (556.216 KB) 12:11:05 | maxrss 1.8% | mem 1.9% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 12:11:05 | maxrss 1.8% | mem 1.9% | DONE (2/9) test item "do_thing Fail" 0.3 secs (97.0% compile), 72.43 K allocs (5.484 MB) No Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 12 Error in testset "do_thing Fail" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.12437291548064078, 0.6889046550302359, 0.6087073880424458] == 1 12:11:06 | maxrss 1.8% | mem 1.9% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 12:11:08 | maxrss 1.8% | mem 1.9% | DONE (3/9) test item "do_thing Error" 2.0 secs (78.7% compile, 0.8% GC), 437.20 K allocs (33.661 MB) No Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 12 Error in testset "do_thing Error" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:587 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:319 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 12:11:08 | maxrss 1.8% | mem 1.9% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 12:11:08 | maxrss 1.8% | mem 1.9% | DONE (4/9) test item "bad setup, good test" 0.6 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 12 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 12 Error in testset "bad setup, good test" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] --- the last 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./client.jl:494 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Base.MainInclude ./client.jl:494 [52] top-level scope @ none:6 [53] eval @ ./boot.jl:385 [inlined] [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:11:08 | maxrss 1.8% | mem 1.9% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 12:11:09 | maxrss 1.8% | mem 1.9% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 12 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 12 Error in testset "bad setup, bad test" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [26] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [27] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [28] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [29] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [30] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [31] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [32] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [33] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [36] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [37] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] --- the last 2 lines are repeated 1 more time --- [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [44] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [45] include @ ./client.jl:494 [inlined] [46] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [47] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [48] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [49] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [50] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [51] include(fname::String) @ Base.MainInclude ./client.jl:494 [52] top-level scope @ none:6 [53] eval @ ./boot.jl:385 [inlined] [54] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:11:09 | maxrss 1.8% | mem 1.9% | START (6/9) test item "errors" at test/error_tests.jl:1 12:11:10 | maxrss 1.8% | mem 1.9% | DONE (6/9) test item "errors" 1.3 secs (10.1% compile), 29.69 K allocs (2.222 MB) No Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 12 Error in testset "UndefVarError" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:385 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [15] redirect_stdio @ ./stream.jl:1376 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [19] open @ ./io.jl:393 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [27] with_logger @ ./logging.jl:630 [inlined] [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [31] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [32] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [33] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [34] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [35] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [36] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [37] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [38] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [41] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [42] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] --- the last 2 lines are repeated 1 more time --- [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [50] include @ ./client.jl:494 [inlined] [51] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [52] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [53] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [54] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [55] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [56] include(fname::String) @ Base.MainInclude ./client.jl:494 [57] top-level scope @ none:6 [58] eval @ ./boot.jl:385 [inlined] [59] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:11:10 | maxrss 1.8% | mem 1.9% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 12:11:10 | maxrss 1.8% | mem 1.9% | DONE (7/9) test item "errors at the top level" 0.4 secs No Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 12 Error in testset "errors at the top level" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:385 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [7] redirect_stdio @ ./stream.jl:1376 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [11] open @ ./io.jl:393 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [19] with_logger @ ./logging.jl:630 [inlined] [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [23] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [24] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [25] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [26] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [27] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [28] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [29] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [30] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [31] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [32] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [33] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [34] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] --- the last 2 lines are repeated 1 more time --- [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [41] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [42] include @ ./client.jl:494 [inlined] [43] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [44] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [45] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [46] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [47] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [48] include(fname::String) @ Base.MainInclude ./client.jl:494 [49] top-level scope @ none:6 [50] eval @ ./boot.jl:385 [inlined] [51] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:11:10 | maxrss 1.8% | mem 1.9% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 12:11:11 | maxrss 1.8% | mem 1.9% | DONE (8/9) test item "nonexistent test setup" 0.3 secs No Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 12 Error in testset "nonexistent test setup" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined Stacktrace: [1] eval @ ./boot.jl:385 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [6] redirect_stdio @ ./stream.jl:1376 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [10] open @ ./io.jl:393 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [18] with_logger @ ./logging.jl:630 [inlined] [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(shouldrun::Function, paths::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:263 [22] runtests(; kw::@Kwargs{}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #107 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:256 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#107#294"}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#107#294"}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [32] encased_testset(f::var"#68#71"{var"#107#294", String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#107#294", name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:255 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] --- the last 2 lines are repeated 1 more time --- [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:225 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./client.jl:494 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Base.MainInclude ./client.jl:494 [48] top-level scope @ none:6 [49] eval @ ./boot.jl:385 [inlined] [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:11:11 | maxrss 1.8% | mem 1.9% | START (9/9) test item "failures" at test/failure_tests.jl:1 12:11:11 | maxrss 1.8% | mem 1.9% | DONE (9/9) test item "failures" <0.1 secs (83.2% compile), 10.70 K allocs (714.272 KB) No Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 12 Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.3425802324273071 < 0 Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. [ Info: Scanning for test items in project `NoDeps` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 12 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.9/activate_set.jl:63 [ Info: Scanning for test items in project `MonoRepo` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:15:31 | maxrss 1.9% | mem 2.0% | START (1/1) test item "MonoRepo tests" at test/monorepo_tests.jl:1 12:15:34 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "MonoRepo tests" 2.6 secs (<0.1% compile), 7.49 K allocs (650.128 KB) [ Tests Completed: 1/1 test items were run. Testing C ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1829 Status `/tmp/jl_jWK2qQ/Project.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [8dfed614] Test Status `/tmp/jl_jWK2qQ/Manifest.toml` [4ee78ca3] C v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` [bf733257] D v0.0.0 `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` [7876af07] Example v0.5.5 [817f1d60] ReTestItems v1.31.0 `~/.julia/packages/ReTestItems/Q6zs8` [1e6cf692] TestEnv v1.102.1 [0dad84c5] ArgTools v1.1.1 [56f22d72] Artifacts [2a0f44e3] Base64 [ade2ca70] Dates [f43a241f] Downloads v1.6.0 [7b1f6079] FileWatching [b77e0a4c] InteractiveUtils [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 [8f399da3] Libdl [56ddb016] Logging [d6f4376e] Markdown [ca575930] NetworkOptions v1.2.0 [44cfe95a] Pkg v1.10.0 [de0858da] Printf [3fa0cd96] REPL [9a3f8284] Random [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization [6462fe0b] Sockets [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test [cf7118a7] UUIDs [4ec0a83e] Unicode [deac9b47] LibCURL_jll v8.4.0+0 [e37daf67] LibGit2_jll v1.6.4+0 [29816b5a] LibSSH2_jll v1.11.0+1 [c8ffd9c3] MbedTLS_jll v2.28.2+1 [14a3606d] MozillaCACerts_jll v2023.1.10 [83775a58] Zlib_jll v1.2.13+1 [8e850ede] nghttp2_jll v1.52.0+1 [3f19e933] p7zip_jll v17.4.0+2 Testing Running tests... [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 3.53 seconds. Scheduling 1 tests on pid 150 12:15:50 | maxrss 1.9% | mem 2.5% | START (1/1) test item "C_tests" at test/c_tests.jl:1 12:15:51 | maxrss 1.9% | mem 2.5% | DONE (1/1) test item "C_tests" 1.2 secs (98.8% compile), 39.88 K allocs (2.681 MB) [ Tests Completed: 1/1 test items were run. Test Summary: | Pass Total Time C | 2 2 3.5s test | 2 2 test/c_tests.jl | 2 2 C_tests | 2 2 1.2s Testing C tests passed Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` ┌ Warning: The project dependencies or compat requirements have changed since the manifest was last resolved. │ It is recommended to `Pkg.resolve()` or consider `Pkg.update()` if necessary. └ @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1142 ┌ Warning: Could not use exact versions of packages in manifest, re-resolving └ @ TestEnv ~/.julia/packages/TestEnv/iS95e/src/julia-1.9/activate_set.jl:63 [ Info: Scanning for test items in project `C` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:15:53 | maxrss 1.9% | mem 2.0% | START (1/1) test item "C_tests" at test/c_tests.jl:1 12:15:53 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "C_tests" <0.1 secs (<0.1% compile), 1.87 K allocs (131.096 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:15:53 | maxrss 1.9% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:15:53 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/bar_tests.jl, test [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:15:54 | maxrss 1.9% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:15:54 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: test, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 1 tests on pid 12 12:15:54 | maxrss 1.9% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:15:54 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 12 12:15:54 | maxrss 1.9% | mem 2.0% | START (1/2) test item "bar" at src/bar_tests.jl:1 12:15:54 | maxrss 1.9% | mem 2.0% | DONE (1/2) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) 12:15:54 | maxrss 1.9% | mem 2.0% | START (2/2) test item "foo" at src/foo_test.jl:1 12:15:54 | maxrss 1.9% | mem 2.0% | DONE (2/2) test item "foo" <0.1 secs (<0.1% compile), 1.74 K allocs (117.160 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: src/foo_test.jl, src/bar_tests.jl [ Info: Finished scanning for test items in 0.61 seconds. Scheduling 1 tests on pid 12 12:15:55 | maxrss 1.9% | mem 2.0% | START (1/1) test item "bar" at src/bar_tests.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (1/1) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 12 12:15:55 | maxrss 1.9% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.29 K allocs (146.200 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) 12:15:55 | maxrss 1.9% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 12:15:55 | maxrss 1.9% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.74 K allocs (117.160 KB) [ Tests Completed: 8/8 test items were run. [ Info: Scanning for test items in project `TestsInSrc` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 8 tests on pid 12 12:15:56 | maxrss 1.9% | mem 2.0% | START (1/8) test item "a1" at src/a_dir/a1_test.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (1/8) test item "a1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (2/8) test item "a2" at src/a_dir/a2_test.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (2/8) test item "a2" <0.1 secs (<0.1% compile), 2.29 K allocs (146.200 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (3/8) test item "z" at src/a_dir/x_dir/x_test.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (3/8) test item "z" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (4/8) test item "y" at src/a_dir/x_dir/x_test.jl:4 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (4/8) test item "y" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (5/8) test item "x" at src/a_dir/x_dir/x_test.jl:7 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (5/8) test item "x" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (6/8) test item "b" at src/b_dir/b_test.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (6/8) test item "b" <0.1 secs (<0.1% compile), 1.35 K allocs (98.000 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (7/8) test item "bar" at src/bar_tests.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (7/8) test item "bar" <0.1 secs (<0.1% compile), 3.04 K allocs (183.680 KB) 12:15:56 | maxrss 1.9% | mem 2.0% | START (8/8) test item "foo" at src/foo_test.jl:1 12:15:56 | maxrss 1.9% | mem 2.0% | DONE (8/8) test item "foo" <0.1 secs (<0.1% compile), 1.74 K allocs (117.160 KB) [ Tests Completed: 8/8 test items were run. ┌ Warning: No such path "" └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:121 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:15:57 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:15:57 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:15:57 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:15:57 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:15:57 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:15:57 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.65 seconds. Scheduling 2 tests on pid 12 12:15:58 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:15:58 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:15:58 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:15:58 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.66 seconds. Scheduling 2 tests on pid 12 12:15:59 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:15:59 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:15:59 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:15:59 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:15:59 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:15:59 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:15:59 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:15:59 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.71 seconds. Scheduling 1 tests on pid 12 12:16:00 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:00 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:16:01 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:01 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:01 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:01 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:01 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:01 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.61 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:16:02 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:02 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.65 seconds. Scheduling 1 tests on pid 12 12:16:03 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:03 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.63 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:16:04 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:16:04 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:16:04 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:16:04 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:04 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:04 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.63 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.64 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.66 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.64 seconds. Scheduling 3 tests on pid 12 12:16:08 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:08 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:08 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:09 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:16:09 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:09 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:16:09 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:16:09 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:16:09 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:09 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:09 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:09 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.61 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.61 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.62 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.66 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.66 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.66 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.63 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_filter_tests.jl [ Info: Finished scanning for test items in 0.65 seconds. Scheduling 3 tests on pid 12 12:16:16 | maxrss 2.0% | mem 2.0% | START (1/3) test item "Test item no tags" at test/testfiles/_filter_tests.jl:1 12:16:16 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "Test item no tags" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) 12:16:16 | maxrss 2.0% | mem 2.0% | START (2/3) test item "Test item tag1" at test/testfiles/_filter_tests.jl:4 12:16:16 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "Test item tag1" <0.1 secs (<0.1% compile), 1.35 K allocs (98.248 KB) 12:16:16 | maxrss 2.0% | mem 2.0% | START (3/3) test item "Test item tag1 tag2" at test/testfiles/_filter_tests.jl:7 12:16:16 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "Test item tag1 tag2" <0.1 secs (<0.1% compile), 1.35 K allocs (98.264 KB) [ Tests Completed: 3/3 test items were run. 12:16:16 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Warn on empty test set -- integration test" at test/testfiles/_empty_testsets_tests.jl:1 12:16:16 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Warn on empty test set -- integration test" <0.1 secs (<0.1% compile), 4.18 K allocs (245.368 KB) [ Tests Completed: 1/1 test items were run. log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 153: [ Info: Starting test worker 1 on pid = 153, with 2 threads\n[ Info: Starting running test items\n Worker 153: 12:16:29 | maxrss 2.0% | mem 2.6% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 153: 12:16:32 | maxrss 2.0% | mem 2.9% | DONE (1/2) test item \"bad setup, good test\" 2.2 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:1842 [inlined]\n [2] macro expansion\n @ ./lock.jl:267 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1823\n [4] #invoke_in_world#3\n @ ./essentials.jl:926 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:923 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1816\n [7] eval\n @ ./boot.jl:385 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1413\n [12] redirect_stdio\n @ ./stream.jl:1376 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:267 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:385 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n Worker 153: 12:16:34 | maxrss 2.0% | mem 2.9% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 153: 12:16:34 | maxrss 2.0% | mem 2.9% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:1842 [inlined]\n [2] macro expansion\n @ ./lock.jl:267 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1823\n [4] #invoke_in_world#3\n @ ./essentials.jl:926 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:923 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1816\n [7] eval\n @ ./boot.jl:385 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1413\n [12] redirect_stdio\n @ ./stream.jl:1376 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:267 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:385 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=153).\n Worker 153: [153] signal (15): Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:650 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 log capture for an errored TestSetup: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 Expression: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1m$(path):1\e[22m\nSetupThatErrors msg\n", replace(c.output, r" on worker \d+" => "")) Evaluated: occursin("\e[36m\e[1mCaptured logs\e[22m\e[39m for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at \e[39m\e[1mtest/error_in_setup_test.jl:1\e[22m\nSetupThatErrors msg\n", "[ Info: Scanning for test items in project `DontPass` at paths: test/error_in_setup_test.jl\n[ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 153: [ Info: Starting test worker 1 on pid = 153, with 2 threads\n[ Info: Starting running test items\n Worker 153: 12:16:29 | maxrss 2.0% | mem 2.6% | START (1/2) test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\n Worker 153: 12:16:32 | maxrss 2.0% | mem 2.9% | DONE (1/2) test item \"bad setup, good test\" 2.2 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, good test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, good test\" at test/error_in_setup_test.jl:5\nError in testset \"bad setup, good test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:1842 [inlined]\n [2] macro expansion\n @ ./lock.jl:267 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1823\n [4] #invoke_in_world#3\n @ ./essentials.jl:926 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:923 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1816\n [7] eval\n @ ./boot.jl:385 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1413\n [12] redirect_stdio\n @ ./stream.jl:1376 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:267 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:385 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n Worker 153: 12:16:34 | maxrss 2.0% | mem 2.9% | START (2/2) test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\n Worker 153: 12:16:34 | maxrss 2.0% | mem 2.9% | DONE (2/2) test item \"bad setup, bad test\" 0.1 secs\n\nCaptured logs for test setup \"SetupThatErrors\" (dependency of \"bad setup, bad test\") at test/error_in_setup_test.jl:1\nSetupThatErrors msg\nNo Captured Logs for test item \"bad setup, bad test\" at test/error_in_setup_test.jl:8\nError in testset \"bad setup, bad test\":\nError During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8\n Got exception outside of a @test\n ArgumentError: Package PackageDoesNotExist not found in current path.\n - Run `import Pkg; Pkg.add(\"PackageDoesNotExist\")` to install the PackageDoesNotExist package.\n Stacktrace:\n [1] macro expansion\n @ ./loading.jl:1842 [inlined]\n [2] macro expansion\n @ ./lock.jl:267 [inlined]\n [3] __require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1823\n [4] #invoke_in_world#3\n @ ./essentials.jl:926 [inlined]\n [5] invoke_in_world\n @ ./essentials.jl:923 [inlined]\n [6] require(into::Module, mod::Symbol)\n @ Base ./loading.jl:1816\n [7] eval\n @ ./boot.jl:385 [inlined]\n [8] #88\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [9] with_source_path(f::ReTestItems.var\"#88#91\"{Expr}, path::String)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914\n [10] #87\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined]\n [11] redirect_stdio(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream})\n @ Base ./stream.jl:1413\n [12] redirect_stdio\n @ ./stream.jl:1376 [inlined]\n [13] _redirect_logs(f::ReTestItems.var\"#87#90\"{Expr, TestSetup}, target::IOStream)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124\n [14] macro expansion\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined]\n [15] macro expansion\n @ ./lock.jl:267 [inlined]\n [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926\n [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool)\n @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062\n [18] top-level scope\n @ none:1\n [19] eval\n @ ./boot.jl:385 [inlined]\n [20] execute\n @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined]\n [21] (::ReTestItems.Workers.var\"#22#23\"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})()\n @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348\n\n[ Info: All tests completed. Closing Worker(pid=153).\n Worker 153: [153] signal (15): Terminated\n\n[ Tests Completed: 2/2 test items were run.\n") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:656 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:638 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 6 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 165: [ Info: Starting test worker 1 on pid = 165, with 2 threads [ Info: Starting running test items Worker 165: 12:17:12 | maxrss 2.0% | mem 2.6% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 165 [165] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:17 ┌ Error: Worker(pid=165, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 169: [ Info: Starting test worker on pid = 169, with 2 threads Worker 169: 12:17:25 | maxrss 2.0% | mem 2.6% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 169 [169] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:17 ┌ Error: Worker(pid=169, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 173: [ Info: Starting test worker on pid = 173, with 2 threads Worker 173: 12:17:37 | maxrss 2.0% | mem 2.6% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 173: [173] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 173 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 173 ┌ Error: Worker(pid=173, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 177: [ Info: Starting test worker on pid = 177, with 2 threads Worker 177: 12:17:49 | maxrss 2.0% | mem 2.6% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 177 [177] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 malloc at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) operator new at /workspace/srcdir/gcc-13.2.0/libstdc++-v3/libsupc++/new_op.cc:50 ┌ Error: Worker(pid=177, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 181: [ Info: Starting test worker on pid = 181, with 2 threads Worker 181: 12:18:01 | maxrss 2.0% | mem 2.6% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 181 [181] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 unknown function (ip: 0x706d2857b30f) __libc_free at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) ┌ Error: Worker(pid=181, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 185: [ Info: Starting test worker on pid = 185, with 2 threads Worker 185: 12:18:13 | maxrss 2.0% | mem 2.6% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 185 [185] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 ┌ Error: Worker(pid=185, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 189: [ Info: Starting test worker on pid = 189, with 2 threads Worker 189: 12:18:25 | maxrss 2.0% | mem 2.6% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 189: [189] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 189 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 189 ┌ Error: Worker(pid=189, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 193: [ Info: Starting test worker on pid = 193, with 2 threads Worker 193: 12:18:37 | maxrss 2.0% | mem 2.6% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 193: [193] signal (15): Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 193 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 193 ┌ Error: Worker(pid=193, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 197: [ Info: Starting test worker on pid = 197, with 2 threads Worker 197: 12:18:49 | maxrss 2.0% | mem 2.6% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 197 [197] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 ┌ Error: Worker(pid=197, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 201: [ Info: Starting test worker on pid = 201, with 2 threads Worker 201: 12:19:01 | maxrss 2.0% | mem 2.6% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 201: [201] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 201 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 201 ┌ Error: Worker(pid=201, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 205: [ Info: Starting test worker on pid = 205, with 2 threads Worker 205: 12:19:13 | maxrss 2.0% | mem 2.6% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 205: [205] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 205 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 205 ┌ Error: Worker(pid=205, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 209: [ Info: Starting test worker on pid = 209, with 2 threads Worker 209: 12:19:24 | maxrss 2.0% | mem 2.6% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 209: [209] signal (15): Terminated in expression starting at none:1 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 209 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 209 ┌ Error: Worker(pid=209, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 213: [ Info: Starting test worker on pid = 213, with 2 threads Worker 213: 12:19:36 | maxrss 2.0% | mem 2.6% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 213: [213] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 213 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 213 ┌ Error: Worker(pid=213, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 217: [ Info: Starting test worker on pid = 217, with 2 threads Worker 217: 12:19:48 | maxrss 2.0% | mem 2.6% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 217 These are the test setup logs. Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 217 [217] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:43 ┌ Error: Worker(pid=217, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 221: [ Info: Starting test worker on pid = 221, with 2 threads Worker 221: 12:20:00 | maxrss 2.0% | mem 2.6% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 221 [221] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x740fa39f8f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=221, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 225: [ Info: Starting test worker on pid = 225, with 2 threads Worker 225: 12:20:12 | maxrss 2.0% | mem 2.6% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 225 [225] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x759873d50f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=225, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 229: [ Info: Starting test worker on pid = 229, with 2 threads Worker 229: 12:20:24 | maxrss 2.0% | mem 2.6% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 229 [229] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x718430409f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=229, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 233: [ Info: Starting test worker on pid = 233, with 2 threads Worker 233: 12:20:34 | maxrss 2.0% | mem 2.6% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 233 [233] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x725c7784ff14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=233, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 237: [ Info: Starting test worker on pid = 237, with 2 threads Worker 237: 12:20:45 | maxrss 2.0% | mem 2.6% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 237: 12:20:46 | maxrss 2.0% | mem 2.6% | DONE (6/6) test item "Timeout first, pass after" 1.0 secs (98.3% compile), 73.90 K allocs (5.120 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=237). Worker 237: [237] signal (15): Terminated [ Tests Completed: 6/6 test items were run. test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 Expression: read_count(joinpath(tmpdir, "num_runs_1")) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:716 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 Expression: read_count(joinpath(tmpdir, "num_runs_2")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:718 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 Expression: read_count(joinpath(tmpdir, "num_runs_3")) == 5 Evaluated: 1 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:721 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 Expression: read_count(joinpath(tmpdir, "num_runs_4")) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:724 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 test retrying failing testitem: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 Expression: n_passed(results) == 3 Evaluated: 1 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:734 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:705 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 241: [ Info: Starting test worker 1 on pid = 241, with 2 threads [ Info: Starting running test items Worker 241: 12:20:57 | maxrss 2.0% | mem 2.6% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 241 [241] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7778cda18f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=241, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 245: [ Info: Starting test worker on pid = 245, with 2 threads Worker 245: 12:21:08 | maxrss 2.0% | mem 2.6% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 245 [245] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:11 ┌ Error: Worker(pid=245, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=245, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=245, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:774 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:766 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1527 [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:776 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:767 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [7] include @ ./client.jl:494 [inlined] [8] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [9] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [13] include(fname::String) @ Base.MainInclude ./client.jl:494 [14] top-level scope @ none:6 [15] eval @ ./boot.jl:385 [inlined] [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [17] _start() @ Base ./client.jl:557 DEBUG @ ReTestItems.jl:338 | Running tests in `("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",)` for project at `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` DEBUG @ ReTestItems.jl:347 | Activating test environment for `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/Project.toml` [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl DEBUG @ ReTestItems.jl:373 | Including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/B/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/C/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/monorepo_packages/D/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/MonoRepo.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/NoDeps.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestProjectFile.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/a_dir/x_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/src/b_dir` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:780 | Skipping files in `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl/test` in subproject `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestsInSrc.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_testsetup.jl` DEBUG @ ReTestItems.jl:808 | Including test items from file `/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl` DEBUG @ ReTestItems.jl:378 | Done including tests in ("/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl",) [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 249: [ Info: Starting test worker 1 on pid = 249, with 2 threads [ Info: Starting running test items Worker 249: 12:21:19 | maxrss 2.0% | mem 2.6% | START (1/2) test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 249 [249] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:2 unknown function (ip: 0x7d377212df14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=249, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 253: [ Info: Starting test worker on pid = 253, with 2 threads Worker 253: 12:21:30 | maxrss 2.0% | mem 2.6% | START (2/2) test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 253 [253] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl:11 ┌ Error: Worker(pid=253, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 4 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=253, terminated=true, termsignal=9). DEBUG @ ReTestItems.jl:704 | Worker 1 closed: Worker(pid=253, terminated=true, termsignal=9) [ Tests Completed: 2/2 test items were run. DEBUG @ testcontext.jl:111 | Recording testitem results DEBUG @ testcontext.jl:120 | Recording dir "test" to dir "ReTestItems" DEBUG @ testcontext.jl:120 | Recording dir "test/testfiles" to dir "test" DEBUG @ testcontext.jl:129 | Recording file "test/testfiles/_timeout_tests.jl" to dir "test/testfiles" DEBUG @ testcontext.jl:138 | Recording TestItem "Test item takes 60 seconds" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:138 | Recording TestItem "Test which should run after timeout" to file "test/testfiles/_timeout_tests.jl" DEBUG @ testcontext.jl:115 | Done recording testitem results DEBUG @ ReTestItems.jl:459 | Calling Test.finish(testitems) DEBUG @ ReTestItems.jl:463 | Cleaning up test setup logs DEBUG @ ReTestItems.jl:472 | Done cleaning up test setup logs DEBUG @ ReTestItems.jl:474 | DONE testitem_timeout set via env variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:796 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 testitem_timeout set via env variable: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:786 Got exception outside of a @test ArgumentError: Collection has multiple elements, must contain exactly 1 element Stacktrace: [1] only(x::Vector{Error}) @ Base.Iterators ./iterators.jl:1527 [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:798 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:787 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [7] include @ ./client.jl:494 [inlined] [8] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [9] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [13] include(fname::String) @ Base.MainInclude ./client.jl:494 [14] top-level scope @ none:6 [15] eval @ ./boot.jl:385 [inlined] [16] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [17] _start() @ Base ./client.jl:557 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 257: [ Info: Starting test worker 1 on pid = 257, with 2 threads [ Info: Starting running test items Worker 257: 12:21:41 | maxrss 2.0% | mem 2.6% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 257 [257] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7e5905760f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=257, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=257, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 261: [ Info: Starting test worker 1 on pid = 261, with 2 threads [ Info: Starting running test items Worker 261: 12:21:54 | maxrss 2.0% | mem 2.6% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 261 [261] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x703845b6ef14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=261, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=261, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 265: [ Info: Starting test worker 1 on pid = 265, with 2 threads [ Info: Starting running test items Worker 265: 12:22:08 | maxrss 2.0% | mem 2.6% | START (1/1) test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 Captured Logs for test item "Sets timeout=6" at test/testfiles/_timeout2_tests.jl:1 on worker 265 [265] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout2_tests.jl:2 unknown function (ip: 0x7dc810daef14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=265, terminated=true, termsignal=9) timed out running test item "Sets timeout=6" after 6 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=265, terminated=true, termsignal=9). [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_nworker_threads_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 with 1 worker processes and 3,2 threads per worker. [ Info: Starting test workers Worker 273: [ Info: Starting test worker 1 on pid = 273, with 3,2 threads [ Info: Starting running test items Worker 273: 12:22:35 | maxrss 2.0% | mem 2.6% | START (1/1) test item "Was spawned with 3,2 threads" at test/testfiles/_nworker_threads_test.jl:2 Worker 273: 12:22:36 | maxrss 2.0% | mem 2.6% | DONE (1/1) test item "Was spawned with 3,2 threads" 1.1 secs (98.7% compile), 29.86 K allocs (1.912 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=273). Worker 273: [273] signal (15): Terminated [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl WARNING: Method definition filter_func(Any) in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:874 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:908. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.06 seconds. Scheduling 3 tests on pid 12 12:22:40 | maxrss 2.0% | mem 2.0% | START (1/3) test item "ti" at test/testfiles/_support_rai_test.jl:3 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "ti" <0.1 secs (<0.1% compile), 1.40 K allocs (100.360 KB) 12:22:40 | maxrss 2.0% | mem 2.0% | START (2/3) test item "other A" at test/integrationtests.jl:900 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "other A" <0.1 secs (<0.1% compile), 1.53 K allocs (113.040 KB) 12:22:40 | maxrss 2.0% | mem 2.0% | START (3/3) test item "other B" at test/integrationtests.jl:900 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "other B" <0.1 secs (<0.1% compile), 1.53 K allocs (113.040 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:22:40 | maxrss 2.0% | mem 2.0% | START (1/1) test item "ti" at test/testfiles/_support_rai_test.jl:3 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "ti" <0.1 secs (<0.1% compile), 1.40 K allocs (100.360 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:22:40 | maxrss 2.0% | mem 2.0% | START (1/2) test item "other A" at test/integrationtests.jl:900 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "other A" <0.1 secs (<0.1% compile), 1.53 K allocs (113.040 KB) 12:22:40 | maxrss 2.0% | mem 2.0% | START (2/2) test item "other B" at test/integrationtests.jl:900 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "other B" <0.1 secs (<0.1% compile), 1.53 K allocs (113.040 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:22:40 | maxrss 2.0% | mem 2.0% | START (1/1) test item "other B" at test/integrationtests.jl:900 12:22:40 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "other B" <0.1 secs (<0.1% compile), 1.53 K allocs (113.040 KB) [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_support_rai_test.jl [ Info: Finished scanning for test items in 0.37 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_names_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:22:41 | maxrss 2.0% | mem 2.0% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 12:22:41 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "same name" <0.1 secs (<0.1% compile), 1.35 K allocs (98.208 KB) 12:22:41 | maxrss 2.0% | mem 2.0% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 12:22:41 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.35 K allocs (98.208 KB) [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name1_test.jl, /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_same_name2_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 280: [ Info: Starting test worker 1 on pid = 280, with 2 threads [ Info: Starting running test items Worker 280: 12:22:50 | maxrss 2.0% | mem 2.6% | START (1/2) test item "same name" at test/testfiles/_same_name1_test.jl:2 Worker 280: 12:22:51 | maxrss 2.0% | mem 2.6% | DONE (1/2) test item "same name" 0.8 secs (98.6% compile), 22.93 K allocs (1.491 MB) Worker 280: 12:22:53 | maxrss 2.0% | mem 2.6% | START (2/2) test item "same name" at test/testfiles/_same_name2_test.jl:2 Worker 280: 12:22:53 | maxrss 2.0% | mem 2.6% | DONE (2/2) test item "same name" <0.1 secs (<0.1% compile), 1.35 K allocs (98.336 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=280). Worker 280: [280] signal (15): Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_duplicate_id_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_timeout_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 284: [ Info: Starting test worker 1 on pid = 284, with 2 threads [ Info: Starting running test items Worker 284: [284] signal (15): Terminated in expression starting at none:1 No Captured Logs for test item "Test item takes 60 seconds" at test/testfiles/_timeout_tests.jl:1 on worker 284 ┌ Error: Worker(pid=284, terminated=true, termsignal=9) timed out running test item "Test item takes 60 seconds" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 288: [ Info: Starting test worker on pid = 288, with 2 threads Worker 288: [288] signal (15): Terminated in expression starting at none:1 No Captured Logs for test item "Test which should run after timeout" at test/testfiles/_timeout_tests.jl:10 on worker 288 ┌ Error: Worker(pid=288, terminated=true, termsignal=9) timed out running test item "Test which should run after timeout" after 3 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=288, terminated=true, termsignal=9). [ Tests Completed: 2/2 test items were run. non-zero timeout_profile_wait means we collect a CPU profile: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1005 Expression: count(r"pthread_cond_wait|__psych_cvwait", logs) > 0 Evaluated: 0 > 0 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] (::var"#207#397"{Float64})(logs::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1005 [3] (::var"#capture_timeout_profile#390"{var"#capture_timeout_profile#201#391"})(f::var"#207#397"{Float64}, timeout_profile_wait::Int64; kwargs::@Kwargs{}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:983 [4] (::var"#capture_timeout_profile#390"{var"#capture_timeout_profile#201#391"})(f::Function, timeout_profile_wait::Int64) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:968 [5] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1003 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1003 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:965 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [11] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 RETESTITEMS_TIMEOUT_PROFILE_WAIT environment variable: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1025 Expression: count(r"pthread_cond_wait|__psych_cvwait", logs) > 0 Evaluated: 0 > 0 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] (::var"#210#400")(logs::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1025 [3] (::var"#capture_timeout_profile#390"{var"#capture_timeout_profile#201#391"})(f::var"#210#400", timeout_profile_wait::Nothing; kwargs::@Kwargs{}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:983 [4] (::var"#capture_timeout_profile#390"{var"#capture_timeout_profile#201#391"})(f::Function, timeout_profile_wait::Nothing) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:968 [5] (::var"#209#399")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1023 [6] withenv(f::var"#209#399", keyvals::Pair{String, String}) @ Base ./env.jl:257 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1022 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [9] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1022 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [11] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:965 [inlined] [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [13] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:27:16 | maxrss 2.0% | mem 2.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 2.01 K allocs (130.144 KB) 12:27:16 | maxrss 2.0% | mem 2.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.01 K allocs (130.144 KB) 12:27:16 | maxrss 2.0% | mem 2.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.01 K allocs (130.144 KB) [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 12:27:16 | maxrss 2.0% | mem 2.0% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (1/3) test item "happy 1" <0.1 secs (<0.1% compile), 1.74 K allocs (116.624 KB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 12 Error in testset "happy 1" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 12:27:16 | maxrss 2.0% | mem 2.0% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.74 K allocs (116.624 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 12 Error in testset "happy 2" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 12:27:16 | maxrss 2.0% | mem 2.0% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 12:27:16 | maxrss 2.0% | mem 2.0% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.74 K allocs (116.624 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 12 Error in testset "happy 3" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 388: [ Info: Starting test worker 1 on pid = 388, with 2 threads [ Info: Starting running test items Worker 388: 12:27:26 | maxrss 2.0% | mem 2.6% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 388: 12:27:28 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item "happy 1" 1.1 secs (98.6% compile), 25.67 K allocs (1.606 MB) Worker 388: 12:27:29 | maxrss 2.0% | mem 2.6% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 388: 12:27:29 | maxrss 2.0% | mem 2.6% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.02 K allocs (130.272 KB) Worker 388: 12:27:30 | maxrss 2.0% | mem 2.6% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 388: 12:27:30 | maxrss 2.0% | mem 2.6% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.02 K allocs (130.272 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=388). Worker 388: [388] signal (15): Terminated in expression starting at none:1 unknown function (ip: 0x7a0aff1b0f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 392: [ Info: Starting test worker 1 on pid = 392, with 2 threads [ Info: Starting running test items Worker 392: 12:27:39 | maxrss 2.0% | mem 2.6% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 392: 12:27:41 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item "happy 1" 1.1 secs (98.6% compile), 25.47 K allocs (1.597 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 392 Error in testset "happy 1" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 392: 12:27:43 | maxrss 2.0% | mem 2.6% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 392: 12:27:43 | maxrss 2.0% | mem 2.6% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.74 K allocs (116.752 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 392 Error in testset "happy 2" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 392: 12:27:43 | maxrss 2.0% | mem 2.6% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 392: 12:27:43 | maxrss 2.0% | mem 2.6% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.74 K allocs (116.752 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 392 Error in testset "happy 3" on worker 392: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=392). Worker 392: [392] signal (15): Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 398: [ Info: Starting test worker 2 on pid = 398, with 2 threads Worker 396: [ Info: Starting test worker 1 on pid = 396, with 2 threads [ Info: Starting running test items Worker 396: 12:28:02 | maxrss 2.0% | mem 2.9% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 398: 12:28:02 | maxrss 2.0% | mem 2.9% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 398: 12:28:05 | maxrss 2.0% | mem 2.9% | DONE (2/3) test item "happy 2" 2.3 secs (98.7% compile), 25.66 K allocs (1.606 MB) Worker 396: 12:28:05 | maxrss 2.0% | mem 2.9% | DONE (1/3) test item "happy 1" 2.3 secs (98.5% compile), 25.67 K allocs (1.606 MB) [ Info: All tests on worker 1 completed. Closing Worker(pid=396). Worker 398: 12:28:06 | maxrss 2.0% | mem 2.9% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 398: 12:28:06 | maxrss 2.0% | mem 2.9% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.02 K allocs (130.272 KB) Worker 396: [396] signal (15): Terminated [ Info: All tests on worker 2 completed. Closing Worker(pid=398). Worker 398: [398] signal (15): Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 2 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 404: [ Info: Starting test worker 1 on pid = 404, with 2 threads Worker 406: [ Info: Starting test worker 2 on pid = 406, with 2 threads [ Info: Starting running test items Worker 406: 12:28:27 | maxrss 2.0% | mem 3.2% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 404: 12:28:27 | maxrss 2.0% | mem 3.2% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 406: 12:28:30 | maxrss 2.0% | mem 3.3% | DONE (2/3) test item "happy 2" 2.4 secs (98.3% compile), 25.47 K allocs (1.597 MB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 406 Error in testset "happy 2" on worker 406: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 Worker 404: 12:28:31 | maxrss 2.0% | mem 3.1% | DONE (1/3) test item "happy 1" 2.4 secs (99.2% compile), 25.47 K allocs (1.597 MB) Worker 406: 12:28:31 | maxrss 2.0% | mem 3.1% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 406: 12:28:31 | maxrss 2.0% | mem 3.1% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.74 K allocs (116.752 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 406 Error in testset "happy 3" on worker 406: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 2 completed. Closing Worker(pid=406). No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 404 Error in testset "happy 1" on worker 404: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1120 Expression: 1 == 2 Evaluated: 1 == 2 [ Info: All tests on worker 1 completed. Closing Worker(pid=404). Worker 404: [404] signal (15): Terminated [ Tests Completed: 3/3 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 412: [ Info: Starting test worker 1 on pid = 412, with 2 threads [ Info: Starting running test items Worker 412: 12:28:43 | maxrss 2.0% | mem 2.6% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 412: 12:28:44 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item "happy 1" 1.1 secs (98.7% compile), 25.70 K allocs (1.618 MB) Worker 412: 12:28:46 | maxrss 2.0% | mem 2.6% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 412: 12:28:46 | maxrss 2.0% | mem 2.6% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 1.67 K allocs (113.232 KB) Worker 412: 12:28:46 | maxrss 2.0% | mem 2.6% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 412: 12:28:46 | maxrss 2.0% | mem 2.6% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 1.67 K allocs (113.232 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=412). Worker 412: [412] signal (15): Terminated [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 Expression: contains(c3.output, r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Total Time\nReTestItems | 6 6 13.7s\n", r"Test Summary: \| Pass Total Time ReTestItems \| 6 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1143 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_happy_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 416: [ Info: Starting test worker 1 on pid = 416, with 2 threads [ Info: Starting running test items Worker 416: 12:28:57 | maxrss 2.0% | mem 2.6% | START (1/3) test item "happy 1" at test/testfiles/_happy_tests.jl:1 Worker 416: 12:28:59 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item "happy 1" 1.5 secs (98.7% compile), 50.33 K allocs (3.389 MB) No Captured Logs for test item "happy 1" at test/testfiles/_happy_tests.jl:1 on worker 416 Error in testset "post-testitem" on worker 416: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 416: 12:28:59 | maxrss 2.0% | mem 2.6% | START (2/3) test item "happy 2" at test/testfiles/_happy_tests.jl:5 Worker 416: 12:28:59 | maxrss 2.0% | mem 2.6% | DONE (2/3) test item "happy 2" <0.1 secs (<0.1% compile), 2.37 K allocs (149.280 KB) No Captured Logs for test item "happy 2" at test/testfiles/_happy_tests.jl:5 on worker 416 Error in testset "post-testitem" on worker 416: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false Worker 416: 12:28:59 | maxrss 2.0% | mem 2.6% | START (3/3) test item "happy 3" at test/testfiles/_happy_tests.jl:9 Worker 416: 12:28:59 | maxrss 2.0% | mem 2.6% | DONE (3/3) test item "happy 3" <0.1 secs (<0.1% compile), 2.37 K allocs (149.280 KB) No Captured Logs for test item "happy 3" at test/testfiles/_happy_tests.jl:9 on worker 416 Error in testset "post-testitem" on worker 416: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1154 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=416). Worker 416: [416] signal (15): Terminated in expression starting at none:1 unknown function (ip: 0x72ca79330f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 [ Tests Completed: 3/3 test items were run. report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 Expression: contains(c4.output, r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 12.6s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 1.5s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"Test Summary: \| Pass Fail Total Time ReTestItems \| 3 3 6 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1165 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 report printing: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 Expression: contains(c4.output, r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Evaluated: contains("Test Summary: | Pass Fail Total Time\nReTestItems | 3 3 6 12.6s\n test | 3 3 6 \n test/testfiles | 3 3 6 \n test/testfiles/_happy_tests.jl | 3 3 6 \n happy 1 | 1 1 2 1.5s\n post-testitem | 1 1 0.1s\n happy 2 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n happy 3 | 1 1 2 0.0s\n post-testitem | 1 1 0.0s\n", r"\s* happy 1 \| 1 1 2 \d.\ds \s* post-testitem \| 1 1 \d.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1172 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1131 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1100 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 Activating project at `~/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl` [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.0 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 420: [ Info: Starting test worker 1 on pid = 420, with 2 threads [ Info: Starting running test items Worker 420: 12:29:10 | maxrss 2.0% | mem 2.6% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 420: 12:29:12 | maxrss 2.0% | mem 2.6% | DONE (1/2) test item "correct usage" 1.1 secs (99.0% compile), 38.81 K allocs (2.583 MB) Worker 420: 12:29:13 | maxrss 2.0% | mem 2.6% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 420: 12:29:13 | maxrss 2.0% | mem 2.6% | DONE (2/2) test item "incorrect usage" <0.1 secs (66.0% compile), 2.16 K allocs (157.192 KB) [ Info: All tests on worker 1 completed. Closing Worker(pid=420). Worker 420: [420] signal (15): Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `TestEndExpr` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/TestEndExpr.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 424: [ Info: Starting test worker 1 on pid = 424, with 2 threads [ Info: Starting running test items Worker 424: 12:29:23 | maxrss 2.0% | mem 2.6% | START (1/2) test item "correct usage" at test/page_tests.jl:1 Worker 424: 12:29:26 | maxrss 2.0% | mem 2.6% | DONE (1/2) test item "correct usage" 1.5 secs (98.6% compile), 128.07 K allocs (8.959 MB) Worker 424: 12:29:28 | maxrss 2.0% | mem 2.6% | START (2/2) test item "incorrect usage" at test/page_tests.jl:7 Worker 424: 12:29:28 | maxrss 2.0% | mem 2.6% | DONE (2/2) test item "incorrect usage" <0.1 secs (65.0% compile), 3.58 K allocs (234.480 KB) No Captured Logs for test item "incorrect usage" at test/page_tests.jl:7 on worker 424 Error in testset "no pins left at end of test" on worker 424: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1198 Expression: count_pins(p) == 0 Evaluated: 1 == 0 [ Info: All tests on worker 1 completed. Closing Worker(pid=424). Worker 424: [424] signal (15): Terminated [ Tests Completed: 2/2 test items were run. [ Info: Scanning for test items in project `DontPass` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 9 tests on pid 12 12:29:29 | maxrss 2.0% | mem 2.0% | START (1/9) test item "do_thing Pass" at src/do_thing_tests.jl:1 12:29:29 | maxrss 2.0% | mem 2.0% | DONE (1/9) test item "do_thing Pass" 0.1 secs (92.8% compile, 59.5% recompile), 24.04 K allocs (1.784 MB) 12:29:29 | maxrss 2.0% | mem 2.0% | START (2/9) test item "do_thing Fail" at src/do_thing_tests.jl:4 12:29:29 | maxrss 2.0% | mem 2.0% | DONE (2/9) test item "do_thing Fail" <0.1 secs (<0.1% compile), 2.01 K allocs (133.320 KB) Captured Logs for test item "do_thing Fail" at src/do_thing_tests.jl:4 on worker 12 [ Info: RUNNING Error in testset "do_thing Fail" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:5 Expression: do_thing() == 1 Evaluated: [0.12437291548064078, 0.6889046550302359, 0.6087073880424458] == 1 12:29:29 | maxrss 2.0% | mem 2.0% | START (3/9) test item "do_thing Error" at src/do_thing_tests.jl:7 12:29:29 | maxrss 2.0% | mem 2.0% | DONE (3/9) test item "do_thing Error" 0.4 secs (<0.1% compile), 20.76 K allocs (2.597 MB) Captured Logs for test item "do_thing Error" at src/do_thing_tests.jl:7 on worker 12 [ Info: RUNNING Error in testset "do_thing Error" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 Test threw exception Expression: 1 + do_thing() == 2 MethodError: no method matching +(::Int64, ::Vector{Float64}) For element-wise addition, use broadcasting with dot syntax: scalar .+ array Closest candidates are: +(::Any, ::Any, !Matched::Any, !Matched::Any...) @ Base operators.jl:587 +(::Real, !Matched::Complex{Bool}) @ Base complex.jl:319 +(!Matched::Array, ::Array...) @ Base arraymath.jl:12 ... Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/src/do_thing_tests.jl:8 12:29:29 | maxrss 2.0% | mem 2.0% | START (4/9) test item "bad setup, good test" at test/error_in_setup_test.jl:5 12:29:30 | maxrss 2.0% | mem 2.0% | DONE (4/9) test item "bad setup, good test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, good test") at test/error_in_setup_test.jl:1 on worker 12 SetupThatErrors msg No Captured Logs for test item "bad setup, good test" at test/error_in_setup_test.jl:5 on worker 12 Error in testset "bad setup, good test" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:5 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./client.jl:494 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Base.MainInclude ./client.jl:494 [51] top-level scope @ none:6 [52] eval @ ./boot.jl:385 [inlined] [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:29:30 | maxrss 2.0% | mem 2.0% | START (5/9) test item "bad setup, bad test" at test/error_in_setup_test.jl:8 12:29:30 | maxrss 2.0% | mem 2.0% | DONE (5/9) test item "bad setup, bad test" 0.4 secs Captured logs for test setup "SetupThatErrors" (dependency of "bad setup, bad test") at test/error_in_setup_test.jl:1 on worker 12 SetupThatErrors msg No Captured Logs for test item "bad setup, bad test" at test/error_in_setup_test.jl:8 on worker 12 Error in testset "bad setup, bad test" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_in_setup_test.jl:8 Got exception outside of a @test ArgumentError: Package PackageDoesNotExist not found in current path. - Run `import Pkg; Pkg.add("PackageDoesNotExist")` to install the PackageDoesNotExist package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] eval @ ./boot.jl:385 [inlined] [8] #88 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [9] with_source_path(f::ReTestItems.var"#88#91"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [10] #87 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:952 [inlined] [11] redirect_stdio(f::ReTestItems.var"#87#90"{Expr, TestSetup}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [12] redirect_stdio @ ./stream.jl:1376 [inlined] [13] _redirect_logs(f::ReTestItems.var"#87#90"{Expr, TestSetup}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [14] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:951 [inlined] [15] macro expansion @ ./lock.jl:267 [inlined] [16] ensure_setup!(ctx::ReTestItems.TestContext, setup::Symbol, setups::Vector{TestSetup}, logs::Symbol) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:926 [17] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1062 [18] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [19] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [20] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [21] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [22] with_logger @ ./logging.jl:630 [inlined] [23] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [24] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [25] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [26] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [27] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [28] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [29] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [30] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [31] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [32] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [35] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [36] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [39] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [40] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [41] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [42] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [43] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [44] include @ ./client.jl:494 [inlined] [45] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [46] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [47] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [48] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [49] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [50] include(fname::String) @ Base.MainInclude ./client.jl:494 [51] top-level scope @ none:6 [52] eval @ ./boot.jl:385 [inlined] [53] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:29:30 | maxrss 2.0% | mem 2.0% | START (6/9) test item "errors" at test/error_tests.jl:1 12:29:31 | maxrss 2.0% | mem 2.0% | DONE (6/9) test item "errors" 1.1 secs (<0.1% compile), 20.75 K allocs (1.552 MB) Captured Logs for test item "errors" at test/error_tests.jl:1 on worker 12 [ Info: RUNNING Error in testset "UndefVarError" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Test threw exception Expression: not_defined + 1 == 4 UndefVarError: `not_defined` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "UndefVarError" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 Test threw exception Expression: LinearAlgebra.dot(rand(), rand()) < 0 UndefVarError: `LinearAlgebra` not defined Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:5 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:3 Error in testset "evaluated to non-Boolean" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:8 Expression evaluated to non-Boolean Expression: ErrorSetup.NON_BOOL Value: missing Error in testset "package not in project" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:10 Got exception outside of a @test ArgumentError: Package Example not found in current path. - Run `import Pkg; Pkg.add("Example")` to install the Example package. Stacktrace: [1] macro expansion @ ./loading.jl:1842 [inlined] [2] macro expansion @ ./lock.jl:267 [inlined] [3] __require(into::Module, mod::Symbol) @ Base ./loading.jl:1823 [4] #invoke_in_world#3 @ ./essentials.jl:926 [inlined] [5] invoke_in_world @ ./essentials.jl:923 [inlined] [6] require(into::Module, mod::Symbol) @ Base ./loading.jl:1816 [7] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [9] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:12 [10] eval @ ./boot.jl:385 [inlined] [11] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [12] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [13] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [14] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [15] redirect_stdio @ ./stream.jl:1376 [inlined] [16] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [17] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [18] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [19] open @ ./io.jl:393 [inlined] [20] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [21] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [22] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [23] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [24] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [25] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [26] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [27] with_logger @ ./logging.jl:630 [inlined] [28] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [29] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [30] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [31] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [32] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [33] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [34] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [35] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [36] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [37] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [40] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [41] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [42] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [43] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [46] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [47] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [48] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [49] include @ ./client.jl:494 [inlined] [50] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [51] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [52] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [53] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [54] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [55] include(fname::String) @ Base.MainInclude ./client.jl:494 [56] top-level scope @ none:6 [57] eval @ ./boot.jl:385 [inlined] [58] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:29:31 | maxrss 2.0% | mem 2.0% | START (7/9) test item "errors at the top level" at test/error_tests.jl:17 12:29:31 | maxrss 2.0% | mem 2.0% | DONE (7/9) test item "errors at the top level" 0.3 secs Captured Logs for test item "errors at the top level" at test/error_tests.jl:17 on worker 12 [ Info: RUNNING Error in testset "errors at the top level" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:17 Got exception outside of a @test AssertionError: false Stacktrace: [1] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:19 [2] eval @ ./boot.jl:385 [inlined] [3] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [4] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [5] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [6] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [7] redirect_stdio @ ./stream.jl:1376 [inlined] [8] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [9] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [10] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [11] open @ ./io.jl:393 [inlined] [12] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [13] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [14] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [15] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [16] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [17] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [18] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [19] with_logger @ ./logging.jl:630 [inlined] [20] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [21] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [22] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [23] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [24] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [25] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [26] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [27] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [28] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [29] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [30] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [31] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [32] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [33] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [34] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [35] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [36] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [37] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [38] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [39] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [40] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [41] include @ ./client.jl:494 [inlined] [42] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [43] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [44] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [45] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [46] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [47] include(fname::String) @ Base.MainInclude ./client.jl:494 [48] top-level scope @ none:6 [49] eval @ ./boot.jl:385 [inlined] [50] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 12:29:31 | maxrss 2.0% | mem 2.0% | START (8/9) test item "nonexistent test setup" at test/error_tests.jl:23 12:29:32 | maxrss 2.0% | mem 2.0% | DONE (8/9) test item "nonexistent test setup" 0.3 secs Captured Logs for test item "nonexistent test setup" at test/error_tests.jl:23 on worker 12 [ Info: RUNNING Error in testset "nonexistent test setup" on worker 12: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/error_tests.jl:23 Got exception outside of a @test UndefVarError: `NonexistentSetup` not defined Stacktrace: [1] eval @ ./boot.jl:385 [inlined] [2] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [3] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [4] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [5] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [6] redirect_stdio @ ./stream.jl:1376 [inlined] [7] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [8] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [9] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [10] open @ ./io.jl:393 [inlined] [11] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [13] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [14] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [15] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [16] (::ReTestItems.var"#53#54"{TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [17] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [18] with_logger @ ./logging.jl:630 [inlined] [19] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [20] runtests(::Returns{Bool}, ::String, ::Vararg{String}; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [21] runtests(; kw::@Kwargs{nworkers::Int64, test_end_expr::Expr}) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [22] runtests @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:234 [inlined] [23] #227 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1220 [inlined] [24] #70 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:34 [inlined] [25] activate(f::var"#70#73"{var"#227#417"{Expr}}, new_project::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:1315 [26] #69 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:33 [inlined] [27] cd(f::var"#69#72"{var"#227#417"{Expr}}, dir::String) @ Base.Filesystem ./file.jl:112 [28] #68 @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:32 [inlined] [29] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [inlined] [30] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [31] encased_testset(f::var"#68#71"{var"#227#417"{Expr}, String}) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/_integration_test_tools.jl:54 [32] with_test_package(f::var"#227#417"{Expr}, name::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:31 [33] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1219 [inlined] [34] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [35] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1214 [inlined] [36] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [37] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1211 [inlined] [38] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [39] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [40] include @ ./client.jl:494 [inlined] [41] (::var"#2#4")() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:21 [42] withenv(f::var"#2#4", keyvals::Pair{String, Int64}) @ Base ./env.jl:257 [43] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:17 [inlined] [44] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [45] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:15 [46] include(fname::String) @ Base.MainInclude ./client.jl:494 [47] top-level scope @ none:6 [48] eval @ ./boot.jl:385 [inlined] [49] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [50] _start() @ Base ./client.jl:557 12:29:32 | maxrss 2.0% | mem 2.0% | START (9/9) test item "failures" at test/failure_tests.jl:1 12:29:32 | maxrss 2.0% | mem 2.0% | DONE (9/9) test item "failures" <0.1 secs (<0.1% compile), 2.86 K allocs (186.312 KB) Captured Logs for test item "failures" at test/failure_tests.jl:1 on worker 12 [ Info: RUNNING Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:2 Expression: false Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:4 Expression: LinearAlgebra.dot(rand(), rand()) < 0 Evaluated: 0.3425802324273071 < 0 Error in testset "failures" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/packages/DontPass.jl/test/failure_tests.jl:5 Expression: FailureSetup.FALSE [ Tests Completed: 9/9 test items were run. n_passed(dont_pass_results) = 2 length(failures(dont_pass_results)) = 4 length(errors(dont_pass_results)) = 9 Test Summary: | Pass Fail Error Total Time DontPass | 2 4 9 15 3.0s src | 1 1 1 3 src/do_thing_tests.jl | 1 1 1 3 do_thing Pass | 1 1 0.1s do_thing Fail | 1 1 0.0s do_thing Error | 1 1 0.4s test | 1 3 8 12 test/error_in_setup_test.jl | 2 2 bad setup, good test | 1 1 0.4s bad setup, bad test | 1 1 0.4s test/error_tests.jl | 1 6 7 errors | 4 4 1.1s UndefVarError | 2 2 0.6s evaluated to non-Boolean | 1 1 0.0s package not in project | 1 1 0.4s errors at the top level | 1 1 2 0.3s nonexistent test setup | 1 1 0.3s test/failure_tests.jl | 3 3 failures | 3 3 0.0s WARNING: Method definition memory_percent() in module ReTestItems at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:151 overwritten in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239. WARNING: Method definition memory_percent() in module Main at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1239 overwritten at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1270. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 0.02 seconds. Scheduling 6 tests on pid 12 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 464: [ Info: Starting test worker 1 on pid = 464, with 2 threads [ Info: Starting running test items Worker 464: 12:31:35 | maxrss 2.0% | mem 2.6% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 Worker 464: 12:31:36 | maxrss 2.0% | mem 2.6% | DONE (1/6) test item "no skip, 1 pass" 0.9 secs (98.6% compile), 22.93 K allocs (1.491 MB) Worker 464: 12:31:38 | maxrss 2.0% | mem 2.6% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 Worker 464: 12:31:38 | maxrss 2.0% | mem 2.6% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.60 K allocs (110.816 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 464 Error in testset "skip false, 1 pass, 1 fail" on worker 464: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl:8 Expression: false Worker 464: 12:31:38 | maxrss 2.0% | mem 2.6% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 Worker 464: 12:31:38 | maxrss 2.0% | mem 2.6% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 Worker 464: 12:31:38 | maxrss 2.0% | mem 2.6% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.60 K allocs (110.744 KB) Worker 464: 12:31:39 | maxrss 2.0% | mem 2.6% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 Worker 464: 12:31:40 | maxrss 2.0% | mem 2.6% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Info: All tests on worker 1 completed. Closing Worker(pid=464). Worker 464: [464] signal (15): Terminated [ Tests Completed: 6/6 test items were run. skipping testitems: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 Expression: contains(c.output, r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Evaluated: contains("Test Summary: | Pass Fail Broken Total Time\nReTestItems | 4 1 3 8 16.5s\n test | 4 1 3 8 \n test/testfiles | 4 1 3 8 \n test/testfiles/_skip_tests.jl | 4 1 3 8 \n no skip, 1 pass | 1 1 0.9s\n skip false, 1 pass, 1 fail | 1 1 2 0.0s\n skip true | 1 1 \n skip expr false, 2 pass | 2 2 0.0s\n skip expr true | 1 1 \n skip expr block true | 1 1 \n", r"Test Summary: \s* \| Pass Fail Broken Total Time ReTestItems \s* \| 4 1 3 8 \s*\d*.\ds ") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1286 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1280 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [6] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_tags2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_bad_name3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_invalid_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file1_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file2_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file3_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_misuse_file4_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_parse_error_test.jl 12:31:47 | maxrss 2.0% | mem 2.4% | START test item "should fail" at testfiles/_direct_testitem.jl:5 should fail: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Expression: 1 == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:6 Test Summary: | Fail Total Time should fail | 1 1 4.2s ERROR: LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_direct_testitem.jl:5 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 Expression: n_tests(results) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 471: [ Info: Starting test worker 1 on pid = 471, with 2 threads\n[ Info: Starting running test items\n Worker 471: 12:32:03 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1\n Worker 471: 12:32:04 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.7% compile), 22.92 K allocs (1.491 MB)\n Worker 471: [471] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 471\n┌ Error: Worker(pid=471, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 475: [ Info: Starting test worker on pid = 475, with 2 threads\n Worker 475: 12:32:15 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1\n Worker 475: 12:32:16 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 475: [475] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 475\n┌ Error: Worker(pid=475, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=475, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 Expression: contains(c.output, "[ Fail Fast: 2/3 test items were run.") Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 471: [ Info: Starting test worker 1 on pid = 471, with 2 threads\n[ Info: Starting running test items\n Worker 471: 12:32:03 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1\n Worker 471: 12:32:04 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.7% compile), 22.92 K allocs (1.491 MB)\n Worker 471: [471] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 471\n┌ Error: Worker(pid=471, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 475: [ Info: Starting test worker on pid = 475, with 2 threads\n Worker 475: 12:32:15 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1\n Worker 475: 12:32:16 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 475: [475] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 475\n┌ Error: Worker(pid=475, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=475, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: 2/3 test items were run.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_failure_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 482: [ Info: Starting test worker 3 on pid = 482, with 2 threads\n Worker 479: [ Info: Starting test worker 1 on pid = 479, with 2 threads\n Worker 481: [ Info: Starting test worker 2 on pid = 481, with 2 threads\n[ Info: Starting running test items\n Worker 482: [482] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x788255e4ff14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n Worker 479: [479] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x775c5c6f1f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n Worker 481: [481] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 479\n┌ Error: Worker(pid=479, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 482\n┌ Error: Worker(pid=482, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 481\n┌ Error: Worker(pid=481, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 491: [ Info: Starting test worker on pid = 491, with 2 threads\n Worker 494: [ Info: Starting test worker on pid = 494, with 2 threads\n Worker 496: [ Info: Starting test worker on pid = 496, with 2 threads\n Worker 491: [491] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 on worker 491\n┌ Error: Worker(pid=491, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_failure_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=491, terminated=true, termsignal=9).\n Worker 494: [494] signal (15): Terminated\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_failure_tests.jl:7 on worker 494\n┌ Error: Worker(pid=494, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=494, terminated=true, termsignal=9).\n Worker 496: [496] signal (15): Terminated\n\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 on worker 496\n┌ Error: Worker(pid=496, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=496, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_failure_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 Expression: n_tests(results) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 503: [ Info: Starting test worker 1 on pid = 503, with 2 threads\n[ Info: Starting running test items\n Worker 503: 12:33:19 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_error_tests.jl:1\n Worker 503: 12:33:20 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 503: [503] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 503\n┌ Error: Worker(pid=503, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 507: [ Info: Starting test worker on pid = 507, with 2 threads\n Worker 507: 12:33:31 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_error_tests.jl:1\n Worker 507: 12:33:32 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.9 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 507: [507] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 507\n┌ Error: Worker(pid=507, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=507, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 Expression: contains(c.output, "[ Fail Fast: 2/3 test items were run.") Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 503: [ Info: Starting test worker 1 on pid = 503, with 2 threads\n[ Info: Starting running test items\n Worker 503: 12:33:19 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_error_tests.jl:1\n Worker 503: 12:33:20 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 503: [503] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 503\n┌ Error: Worker(pid=503, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 507: [ Info: Starting test worker on pid = 507, with 2 threads\n Worker 507: 12:33:31 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_error_tests.jl:1\n Worker 507: 12:33:32 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.9 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 507: [507] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 507\n┌ Error: Worker(pid=507, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=507, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: 2/3 test items were run.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_error_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 513: [ Info: Starting test worker 2 on pid = 513, with 2 threads\n Worker 511: [ Info: Starting test worker 1 on pid = 511, with 2 threads\n Worker 514: [ Info: Starting test worker 3 on pid = 514, with 2 threads\n[ Info: Starting running test items\n Worker 511: [511] signal (15): Terminated\nin expression starting at none:1\n\n Worker 513: [513] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x727a7d53bf14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n Worker 514: [514] signal (15): Terminated\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 514\n┌ Error: Worker(pid=514, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 513\n┌ Error: Worker(pid=513, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 511\n┌ Error: Worker(pid=511, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 523: [ Info: Starting test worker on pid = 523, with 2 threads\n Worker 526: [ Info: Starting test worker on pid = 526, with 2 threads\n Worker 528: [ Info: Starting test worker on pid = 528, with 2 threads\n Worker 523: [523] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x7e09bec95f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n Worker 526: [526] signal (15): Terminated\nin expression starting at none:1\n\n Worker 528: [528] signal (15): Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 on worker 523\n┌ Error: Worker(pid=523, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_error_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=523, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 on worker 526\n┌ Error: Worker(pid=526, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=526, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_error_tests.jl:1 on worker 528\n┌ Error: Worker(pid=528, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 1 completed. Closing Worker(pid=528, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_error_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 Expression: n_tests(results) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 535: [ Info: Starting test worker 1 on pid = 535, with 2 threads\n[ Info: Starting running test items\n Worker 535: 12:34:33 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1\n Worker 535: 12:34:34 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 535: [535] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 535\n┌ Error: Worker(pid=535, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 539: [ Info: Starting test worker on pid = 539, with 2 threads\n Worker 539: 12:34:45 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1\n Worker 539: 12:34:46 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.6% compile), 22.92 K allocs (1.491 MB)\n Worker 539: [539] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 539\n┌ Error: Worker(pid=539, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=539, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 Expression: contains(c.output, "[ Fail Fast: 2/3 test items were run.") Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 535: [ Info: Starting test worker 1 on pid = 535, with 2 threads\n[ Info: Starting running test items\n Worker 535: 12:34:33 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1\n Worker 535: 12:34:34 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.5% compile), 22.92 K allocs (1.491 MB)\n Worker 535: [535] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 535\n┌ Error: Worker(pid=535, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 539: [ Info: Starting test worker on pid = 539, with 2 threads\n Worker 539: 12:34:45 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1\n Worker 539: 12:34:46 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.6% compile), 22.92 K allocs (1.491 MB)\n Worker 539: [539] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 539\n┌ Error: Worker(pid=539, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=539, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: 2/3 test items were run.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_timeout_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 546: [ Info: Starting test worker 3 on pid = 546, with 2 threads\n Worker 545: [ Info: Starting test worker 2 on pid = 545, with 2 threads\n Worker 543: [ Info: Starting test worker 1 on pid = 543, with 2 threads\n[ Info: Starting running test items\n Worker 545: [545] signal (15): Terminated\nin expression starting at none:1\n\n Worker 546: [546] signal (15): Terminated\nin expression starting at none:1\n\n Worker 543: [543] signal (15): Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 546\n┌ Error: Worker(pid=546, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 545\n┌ Error: Worker(pid=545, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 543\n┌ Error: Worker(pid=543, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 559: [ Info: Starting test worker on pid = 559, with 2 threads\n Worker 557: [ Info: Starting test worker on pid = 557, with 2 threads\n Worker 555: [ Info: Starting test worker on pid = 555, with 2 threads\n Worker 559: [559] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x75ecbe4e8f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n Worker 557: [557] signal (15): Terminated\nin expression starting at none:1\nunknown function (ip: 0x7be502615f14)\npthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)\nuv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883\nijl_task_get_next at /source/src/partr.c:517\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 on worker 559\n┌ Error: Worker(pid=559, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_timeout_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=559, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 on worker 557\n┌ Error: Worker(pid=557, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=557, terminated=true, termsignal=9).\n Worker 555: [555] signal (15): Terminated\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_timeout_tests.jl:9 on worker 555\n┌ Error: Worker(pid=555, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 3 completed. Closing Worker(pid=555, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_timeout_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 Expression: n_tests(results) == 2 Evaluated: 1 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1382 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 Expression: n_passed(results) == 1 Evaluated: 0 == 1 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1383 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 567: [ Info: Starting test worker 1 on pid = 567, with 2 threads\n[ Info: Starting running test items\n Worker 567: 12:35:46 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1\n Worker 567: 12:35:47 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.7% compile), 22.92 K allocs (1.491 MB)\n Worker 567: [567] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 567\n┌ Error: Worker(pid=567, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 571: [ Info: Starting test worker on pid = 571, with 2 threads\n Worker 571: 12:35:57 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1\n Worker 571: 12:35:59 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.4% compile), 22.92 K allocs (1.491 MB)\n Worker 571: [571] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 571\n┌ Error: Worker(pid=571, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=571, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 Expression: contains(c.output, "[ Fail Fast: 2/3 test items were run.") Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 1 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 567: [ Info: Starting test worker 1 on pid = 567, with 2 threads\n[ Info: Starting running test items\n Worker 567: 12:35:46 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1\n Worker 567: 12:35:47 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.7% compile), 22.92 K allocs (1.491 MB)\n Worker 567: [567] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 567\n┌ Error: Worker(pid=567, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n Worker 571: [ Info: Starting test worker on pid = 571, with 2 threads\n Worker 571: 12:35:57 | maxrss 2.0% | mem 2.6% | START (1/3) test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1\n Worker 571: 12:35:59 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item \"good\" 0.8 secs (98.4% compile), 22.92 K allocs (1.491 MB)\n Worker 571: [571] signal (15): Terminated\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 571\n┌ Error: Worker(pid=571, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 failed. Cancelling tests.\n[ Info: All tests on worker 1 completed. Closing Worker(pid=571, terminated=true, termsignal=9).\n[ Fail Fast: 1/3 test items were run.\n", "[ Fail Fast: 2/3 test items were run.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1393 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 Expression: n_passed(results) == 2 Evaluated: 0 == 2 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1380 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 nworkers=3: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 Expression: contains(c.output, msg) Evaluated: contains("[ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_failfast_crash_tests.jl\n[ Info: Finished scanning for test items in 0.01 seconds. Scheduling 3 tests on pid 12 with 3 worker processes and 2 threads per worker.\n[ Info: Starting test workers\n Worker 575: [ Info: Starting test worker 1 on pid = 575, with 2 threads\n Worker 578: [ Info: Starting test worker 3 on pid = 578, with 2 threads\n Worker 577: [ Info: Starting test worker 2 on pid = 577, with 2 threads\n[ Info: Starting running test items\n Worker 575: [575] signal (15): Terminated\nin expression starting at none:1\n\n Worker 577: [577] signal (15): Terminated\nin expression starting at none:1\n\n Worker 578: [578] signal (15): Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 575\n┌ Error: Worker(pid=575, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"good\" on a new worker 1 process. Run=2.\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 578\n┌ Error: Worker(pid=578, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"may not run\" on a new worker 3 process. Run=2.\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 577\n┌ Error: Worker(pid=577, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: Retrying \"bad\" on a new worker 2 process. Run=2.\n Worker 592: [ Info: Starting test worker on pid = 592, with 2 threads\n Worker 590: [ Info: Starting test worker on pid = 590, with 2 threads\n Worker 587: [ Info: Starting test worker on pid = 587, with 2 threads\n Worker 592: [592] signal (15): Terminated\n\n Worker 590: [590] signal (15): Terminated\n\n\nNo Captured Logs for test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 on worker 590\n┌ Error: Worker(pid=590, terminated=true, termsignal=9) timed out running test item \"may not run\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Fail Fast: Test item \"may not run\" at test/testfiles/_failfast_crash_tests.jl:7 failed. Cancelling tests.\n[ Info: All tests on worker 3 completed. Closing Worker(pid=590, terminated=true, termsignal=9).\n\nNo Captured Logs for test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 on worker 592\n┌ Error: Worker(pid=592, terminated=true, termsignal=9) timed out running test item \"bad\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 2 completed. Closing Worker(pid=592, terminated=true, termsignal=9).\n Worker 587: [587] signal (15): Terminated\nin expression starting at none:1\n\n\nNo Captured Logs for test item \"good\" at test/testfiles/_failfast_crash_tests.jl:1 on worker 587\n┌ Error: Worker(pid=587, terminated=true, termsignal=9) timed out running test item \"good\" after 5 seconds. Recording test error.\n└ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666\n[ Info: All tests on worker 1 completed. Closing Worker(pid=587, terminated=true, termsignal=9).\n[ Fail Fast: 3/3 test items were run.\n", "[ Fail Fast: Test item \"bad\" at test/testfiles/_failfast_crash_tests.jl:4 failed. Cancelling tests.") Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1389 [inlined] [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [4] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1367 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [6] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1355 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:1353 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [10] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/integrationtests.jl:47 [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 1 tests on pid 12 12:37:15 | maxrss 2.0% | mem 2.0% | START (1/1) test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 12:37:15 | maxrss 2.0% | mem 2.0% | DONE (1/1) test item "Test.jl failfast=true keyword" <0.1 secs (Failed Fast) No Captured Logs for test item "Test.jl failfast=true keyword" at test/testfiles/_testset_failfast_tests.jl:2 on worker 12 Error in testset "test set" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testset_failfast_tests.jl:4 Expression: false [ Tests Completed: 1/1 test items were run. [ Info: Scanning for test items in project `ReTestItems` at paths: /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 2 tests on pid 12 12:37:17 | maxrss 2.0% | mem 2.0% | START (1/2) test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 12:37:18 | maxrss 2.0% | mem 2.0% | DONE (1/2) test item "Failure at toplevel" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure at toplevel" at test/testfiles/_testitem_failfast_tests.jl:1 on worker 12 Error in testset "Failure at toplevel" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:3 Expression: false 12:37:18 | maxrss 2.0% | mem 2.0% | START (2/2) test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 12:37:18 | maxrss 2.0% | mem 2.0% | DONE (2/2) test item "Failure in nested testset" 0.1 secs (Failed Fast) No Captured Logs for test item "Failure in nested testset" at test/testfiles/_testitem_failfast_tests.jl:11 on worker 12 Error in testset "Bar" on worker 12: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_testitem_failfast_tests.jl:15 Expression: false [ Tests Completed: 2/2 test items were run. 12:37:26 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:8 12:37:27 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" 0.1 secs (95.5% compile), 41.28 K allocs (3.428 MB) 12:37:27 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:21 12:37:27 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" <0.1 secs, 1.15 K allocs (295.024 KB) 12:37:28 | maxrss 2.0% | mem 2.5% | START test item "uses printstyled" at _test_log_capture.jl:34 12:37:28 | maxrss 2.0% | mem 2.5% | DONE test item "uses printstyled" 0.3 secs (98.0% compile), 145.23 K allocs (11.187 MB) 12:37:28 | maxrss 2.0% | mem 2.5% | START test item "uses @error" at _test_log_capture.jl:47 12:37:29 | maxrss 2.0% | mem 2.5% | DONE test item "uses @error" 1.0 secs (99.1% compile, 4.1% GC), 572.26 K allocs (42.575 MB) 12:37:29 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 12:37:30 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @info" 0.5 secs (97.5% compile), 20.88 K allocs (1.425 MB) 12:37:30 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 12:37:30 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @error" <0.1 secs (67.8% compile), 7.66 K allocs (546.928 KB) 12:37:30 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 12:37:30 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stdout" 0.2 secs (95.8% compile), 37.03 K allocs (2.744 MB) 12:37:31 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 12:37:31 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stderr" 0.1 secs (93.4% compile), 21.88 K allocs (1.635 MB) 12:37:31 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 12:37:31 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (98.1% compile), 142.75 K allocs (10.869 MB) 12:37:32 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger" at _test_log_capture.jl:149 12:37:32 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger" <0.1 secs (86.6% compile), 10.33 K allocs (816.384 KB) 12:37:32 | maxrss 2.0% | mem 2.5% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 12:37:32 | maxrss 2.0% | mem 2.5% | DONE test item "uses display" 0.5 secs (98.6% compile), 169.82 K allocs (10.725 MB) 12:37:33 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:184 12:37:33 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.25 K allocs (101.872 KB) 12:37:33 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:199 12:37:33 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.25 K allocs (101.872 KB) 12:37:34 | maxrss 2.0% | mem 2.5% | START test item "setup uses printstyled" at _test_log_capture.jl:214 12:37:34 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses printstyled" <0.1 secs, 1.25 K allocs (101.872 KB) 12:37:34 | maxrss 2.0% | mem 2.5% | START test item "setup uses @error" at _test_log_capture.jl:229 12:37:34 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses @error" <0.1 secs, 1.25 K allocs (101.872 KB) 12:37:34 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 12:37:34 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.64 K allocs (121.952 KB) 12:37:34 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 12:37:34 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.64 K allocs (121.952 KB) 12:37:35 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 12:37:35 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.66 K allocs (123.080 KB) 12:37:35 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger" at _test_log_capture.jl:315 12:37:35 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger" <0.1 secs, 1.25 K allocs (101.872 KB) 12:37:35 | maxrss 2.0% | mem 2.5% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 12:37:35 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses display" <0.1 secs, 1.25 K allocs (101.872 KB) Test Summary: | Pass Broken Total  Time log capture logs=:eager |  26  2  28 12.3s 12:37:42 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:8 12:37:42 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" 0.1 secs (93.3% compile), 26.39 K allocs (1.949 MB) 12:37:42 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:21 12:37:42 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" <0.1 secs, 1.17 K allocs (91.952 KB) 12:37:42 | maxrss 2.0% | mem 2.5% | START test item "uses printstyled" at _test_log_capture.jl:34 12:37:42 | maxrss 2.0% | mem 2.5% | DONE test item "uses printstyled" <0.1 secs (68.4% compile), 3.69 K allocs (302.728 KB) 12:37:42 | maxrss 2.0% | mem 2.5% | START test item "uses @error" at _test_log_capture.jl:47 12:37:43 | maxrss 2.0% | mem 2.5% | DONE test item "uses @error" 1.0 secs (99.1% compile, 4.4% GC), 564.67 K allocs (41.987 MB) 12:37:43 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 12:37:44 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @info" 0.5 secs (97.6% compile), 20.92 K allocs (1.428 MB) 12:37:44 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 12:37:44 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @error" <0.1 secs (68.1% compile), 7.69 K allocs (549.264 KB) 12:37:44 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 12:37:44 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stdout" 0.3 secs (96.1% compile), 37.20 K allocs (2.752 MB) 12:37:44 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 12:37:44 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stderr" 0.1 secs (93.0% compile), 21.91 K allocs (1.637 MB) 12:37:44 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 12:37:45 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (98.1% compile), 142.79 K allocs (10.873 MB) 12:37:45 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger" at _test_log_capture.jl:149 12:37:45 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger" <0.1 secs (83.5% compile), 8.20 K allocs (594.456 KB) 12:37:45 | maxrss 2.0% | mem 2.5% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 12:37:46 | maxrss 2.0% | mem 2.5% | DONE test item "uses display" 0.8 secs (99.2% compile), 328.74 K allocs (22.850 MB) 12:37:46 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:184 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.29 K allocs (105.336 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:199 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.29 K allocs (104.168 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses printstyled" at _test_log_capture.jl:214 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses printstyled" <0.1 secs, 1.29 K allocs (104.208 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses @error" at _test_log_capture.jl:229 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses @error" <0.1 secs, 1.29 K allocs (104.168 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.68 K allocs (124.304 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.68 K allocs (124.640 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.70 K allocs (125.552 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger" at _test_log_capture.jl:315 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger" <0.1 secs, 1.29 K allocs (104.208 KB) 12:37:47 | maxrss 2.0% | mem 2.5% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 12:37:47 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses display" <0.1 secs, 1.29 K allocs (104.168 KB) Test Summary: | Pass Broken Total Time log capture logs=:batched |  26  2  28 8.6s 12:37:53 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:8 12:37:54 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" 0.1 secs (93.3% compile), 26.39 K allocs (1.949 MB) 12:37:54 | maxrss 2.0% | mem 2.5% | START test item "uses println" at _test_log_capture.jl:21 12:37:54 | maxrss 2.0% | mem 2.5% | DONE test item "uses println" <0.1 secs, 1.17 K allocs (91.952 KB) 12:37:54 | maxrss 2.0% | mem 2.5% | START test item "uses printstyled" at _test_log_capture.jl:34 12:37:54 | maxrss 2.0% | mem 2.5% | DONE test item "uses printstyled" <0.1 secs (67.7% compile), 3.69 K allocs (302.728 KB) 12:37:54 | maxrss 2.0% | mem 2.5% | START test item "uses @error" at _test_log_capture.jl:47 12:37:55 | maxrss 2.0% | mem 2.5% | DONE test item "uses @error" 1.1 secs (99.0% compile, 4.9% GC), 564.67 K allocs (41.987 MB) 12:37:55 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @info" at _test_log_capture.jl:60 12:37:56 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @info" 0.5 secs (97.7% compile), 20.92 K allocs (1.428 MB) 12:37:56 | maxrss 2.0% | mem 2.5% | START test item "uses @test_logs @error" at _test_log_capture.jl:75 12:37:56 | maxrss 2.0% | mem 2.5% | DONE test item "uses @test_logs @error" <0.1 secs (69.3% compile), 7.69 K allocs (549.264 KB) 12:37:56 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stdout" at _test_log_capture.jl:90 12:37:56 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stdout" 0.2 secs (96.1% compile), 37.20 K allocs (2.752 MB) 12:37:56 | maxrss 2.0% | mem 2.5% | START test item "uses redirect_stderr" at _test_log_capture.jl:109 12:37:56 | maxrss 2.0% | mem 2.5% | DONE test item "uses redirect_stderr" 0.1 secs (93.5% compile), 21.91 K allocs (1.637 MB) 12:37:56 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger (redirect to a file)" at _test_log_capture.jl:128 12:37:57 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger (redirect to a file)" 0.6 secs (98.1% compile), 142.79 K allocs (10.873 MB) 12:37:57 | maxrss 2.0% | mem 2.5% | START test item "uses with_logger" at _test_log_capture.jl:149 12:37:57 | maxrss 2.0% | mem 2.5% | DONE test item "uses with_logger" <0.1 secs (83.9% compile), 8.20 K allocs (594.456 KB) 12:37:57 | maxrss 2.0% | mem 2.5% | START test item "uses display" at _test_log_capture.jl:166 "display msg" 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "uses display" 0.8 secs (99.3% compile), 328.74 K allocs (22.850 MB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:184 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.29 K allocs (105.336 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses println" at _test_log_capture.jl:199 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses println" <0.1 secs, 1.29 K allocs (104.168 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses printstyled" at _test_log_capture.jl:214 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses printstyled" <0.1 secs, 1.29 K allocs (104.208 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses @error" at _test_log_capture.jl:229 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses @error" <0.1 secs, 1.29 K allocs (104.168 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stdout" at _test_log_capture.jl:248 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stdout" <0.1 secs (<0.1% compile), 1.68 K allocs (124.304 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses redirect_stderr" at _test_log_capture.jl:270 12:37:58 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses redirect_stderr" <0.1 secs (<0.1% compile), 1.68 K allocs (124.640 KB) 12:37:58 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger (redirect to a file)" at _test_log_capture.jl:293 12:37:59 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger (redirect to a file)" <0.1 secs (<0.1% compile), 1.70 K allocs (125.552 KB) 12:37:59 | maxrss 2.0% | mem 2.5% | START test item "setup uses with_logger" at _test_log_capture.jl:315 12:37:59 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses with_logger" <0.1 secs, 1.29 K allocs (104.208 KB) 12:37:59 | maxrss 2.0% | mem 2.5% | START test item "setup uses display" at _test_log_capture.jl:330 "display msg" 12:37:59 | maxrss 2.0% | mem 2.5% | DONE test item "setup uses display" <0.1 secs, 1.29 K allocs (104.168 KB) Test Summary: | Pass Broken Total Time log capture logs=:issues |  26  2  28 8.5s Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 3.73 seconds. Scheduling 6 tests on pid 622 12:38:30 | maxrss 2.0% | mem 2.6% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 12:38:32 | maxrss 2.0% | mem 2.6% | DONE (1/6) test item "testitem1" 1.1 secs (98.9% compile), 32.17 K allocs (2.056 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 622 Error in testset "testitem1" on worker 622: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 12:38:32 | maxrss 2.0% | mem 2.6% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 12:38:33 | maxrss 2.0% | mem 2.6% | DONE (2/6) test item "testitem2" 0.4 secs (94.6% compile), 30.16 K allocs (2.161 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 622 Error in testset "inner testset" on worker 622: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 622: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" 12:38:33 | maxrss 2.0% | mem 2.6% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 12:38:33 | maxrss 2.0% | mem 2.6% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 1.65 K allocs (112.712 KB) 12:38:33 | maxrss 2.0% | mem 2.6% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 12:38:35 | maxrss 2.0% | mem 2.8% | DONE (4/6) test item "testitem4" 2.1 secs (80.1% compile, 1.3% GC), 437.16 K allocs (33.377 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 622 Error in testset "nested testset" on worker 622: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [19] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [20] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [21] with_logger @ ./logging.jl:630 [inlined] [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [24] #runtests#46 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:236 [inlined] [25] top-level scope @ none:1 [26] eval @ ./boot.jl:385 [inlined] [27] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [28] _start() @ Base ./client.jl:557 12:38:35 | maxrss 2.0% | mem 2.8% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 12:38:35 | maxrss 2.0% | mem 2.8% | DONE (5/6) test item "testitem5" <0.1 secs (91.0% compile), 2.07 K allocs (133.320 KB) 12:38:35 | maxrss 2.0% | mem 2.8% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 12:38:35 | maxrss 2.0% | mem 2.8% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (144.880 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 622 Error in testset "testitem6" on worker 622: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_lSgHhX/report-ReTestItems-20250606-123830.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 7.4s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 1.1s testitem2 | 1 1 1 3 0.4s inner testset | 1 1 2 0.1s testitem3 | 2 2 0.0s testitem4 | 1 1 2.1s nested testset | 1 1 2.1s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 3.76 seconds. Scheduling 6 tests on pid 626 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 629: [ Info: Starting test worker 1 on pid = 629, with 2 threads [ Info: Starting running test items Worker 629: 12:39:11 | maxrss 1.1% | mem 3.1% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 Worker 629: 12:39:13 | maxrss 1.1% | mem 3.1% | DONE (1/6) test item "testitem1" 1.1 secs (98.7% compile), 25.46 K allocs (1.596 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 629 Error in testset "testitem1" on worker 629: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 Worker 629: 12:39:13 | maxrss 1.1% | mem 3.2% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 Worker 629: 12:39:14 | maxrss 1.1% | mem 3.2% | DONE (2/6) test item "testitem2" 0.4 secs (96.0% compile), 30.42 K allocs (2.173 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 629 Error in testset "inner testset" on worker 629: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 629: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" Worker 629: 12:39:16 | maxrss 1.1% | mem 3.2% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 Worker 629: 12:39:16 | maxrss 1.1% | mem 3.2% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 1.65 K allocs (112.840 KB) Worker 629: 12:39:16 | maxrss 1.1% | mem 3.2% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 Worker 629: 12:39:18 | maxrss 1.1% | mem 3.2% | DONE (4/6) test item "testitem4" 1.7 secs (96.1% compile), 434.77 K allocs (33.206 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 629 Error in testset "nested testset" on worker 629: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] top-level scope @ none:1 [18] eval @ ./boot.jl:385 [inlined] [19] execute @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] [20] (::ReTestItems.Workers.var"#22#23"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})() @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 Worker 629: 12:39:18 | maxrss 1.1% | mem 3.2% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 Worker 629: 12:39:18 | maxrss 1.1% | mem 3.2% | DONE (5/6) test item "testitem5" <0.1 secs (90.4% compile), 2.07 K allocs (133.448 KB) Worker 629: 12:39:18 | maxrss 1.1% | mem 3.2% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 Worker 629: 12:39:18 | maxrss 1.1% | mem 3.2% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (145.008 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 629 Error in testset "testitem6" on worker 629: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=629). Worker 629: [629] signal (15): Terminated [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_rwBCbb/report-ReTestItems-20250606-123911.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 27.8s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 1.1s testitem2 | 1 1 1 3 0.4s inner testset | 1 1 2 0.1s testitem3 | 2 2 0.0s testitem4 | 1 1 1.7s nested testset | 1 1 1.7s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 3.68 seconds. Scheduling 6 tests on pid 634 12:39:41 | maxrss 2.0% | mem 2.6% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 12:39:42 | maxrss 2.0% | mem 2.7% | DONE (1/6) test item "testitem1" 1.0 secs (98.9% compile), 32.17 K allocs (2.056 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 634 Error in testset "testitem1" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 [ Info: Retrying "testitem1". Run=2. 12:39:43 | maxrss 2.0% | mem 2.7% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 12:39:43 | maxrss 2.0% | mem 2.7% | DONE (1/6) test item "testitem1" <0.1 secs (<0.1% compile), 1.72 K allocs (116.184 KB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 634 Error in testset "testitem1" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 12:39:43 | maxrss 2.0% | mem 2.7% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 12:39:43 | maxrss 2.0% | mem 2.7% | DONE (2/6) test item "testitem2" 0.4 secs (95.5% compile), 30.16 K allocs (2.161 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 634 Error in testset "inner testset" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 634: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" [ Info: Retrying "testitem2". Run=2. 12:39:43 | maxrss 2.0% | mem 2.7% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 12:39:43 | maxrss 2.0% | mem 2.7% | DONE (2/6) test item "testitem2" <0.1 secs (<0.1% compile), 2.64 K allocs (164.224 KB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 634 Error in testset "inner testset" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 634: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" 12:39:43 | maxrss 2.0% | mem 2.7% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 12:39:43 | maxrss 2.0% | mem 2.7% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 1.65 K allocs (112.712 KB) 12:39:43 | maxrss 2.0% | mem 2.7% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 12:39:45 | maxrss 2.0% | mem 2.9% | DONE (4/6) test item "testitem4" 2.1 secs (80.4% compile, 1.6% GC), 437.16 K allocs (33.376 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 634 Error in testset "nested testset" on worker 634: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [19] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [20] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [21] with_logger @ ./logging.jl:630 [inlined] [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [24] #runtests#46 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:236 [inlined] [25] top-level scope @ none:1 [26] eval @ ./boot.jl:385 [inlined] [27] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [28] _start() @ Base ./client.jl:557 [ Info: Retrying "testitem4". Run=2. 12:39:45 | maxrss 2.0% | mem 2.9% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 12:39:45 | maxrss 2.0% | mem 2.9% | DONE (4/6) test item "testitem4" 0.2 secs (<0.1% compile), 8.54 K allocs (670.088 KB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 634 Error in testset "nested testset" on worker 634: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] runtestitem @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1015 [inlined] [18] _runtests_in_current_env(ti_filter::Function, paths::Tuple{String}, projectfile::String, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:398 [19] (::ReTestItems.var"#53#54"{ReTestItems.TestItemFilter{Returns{Bool}, Nothing, Nothing}, Tuple{String}, ReTestItems._Config, String})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:358 [20] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:517 [21] with_logger @ ./logging.jl:630 [inlined] [22] _runtests(ti_filter::Function, paths::Tuple{String}, cfg::ReTestItems._Config) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:341 [23] runtests(shouldrun::Returns{Bool}, paths::String; nworkers::Int64, nworker_threads::String, worker_init_expr::Expr, testitem_timeout::Float64, retries::Int64, memory_threshold::Float64, debug::Int64, name::Nothing, tags::Nothing, report::Bool, logs::Symbol, verbose_results::Bool, test_end_expr::Expr, validate_paths::Bool, timeout_profile_wait::Int64, gc_between_testitems::Bool, failfast::Bool, testitem_failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:311 [24] #runtests#46 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:236 [inlined] [25] top-level scope @ none:1 [26] eval @ ./boot.jl:385 [inlined] [27] exec_options(opts::Base.JLOptions) @ Base ./client.jl:296 [28] _start() @ Base ./client.jl:557 12:39:45 | maxrss 2.0% | mem 2.9% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 12:39:46 | maxrss 2.0% | mem 2.9% | DONE (5/6) test item "testitem5" <0.1 secs (91.9% compile), 2.07 K allocs (133.320 KB) 12:39:46 | maxrss 2.0% | mem 2.9% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 12:39:46 | maxrss 2.0% | mem 2.9% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (144.880 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 634 Error in testset "testitem6" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Info: Retrying "testitem6". Run=2. 12:39:46 | maxrss 2.0% | mem 2.9% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 12:39:46 | maxrss 2.0% | mem 2.9% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (144.880 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 634 Error in testset "testitem6" on worker 634: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_GaX14f/report-ReTestItems-20250606-123941.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 7.5s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 0.0s testitem2 | 1 1 1 3 0.0s inner testset | 1 1 2 0.0s testitem3 | 2 2 0.0s testitem4 | 1 1 0.2s nested testset | 1 1 0.1s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_xml_test.jl [ Info: Finished scanning for test items in 3.77 seconds. Scheduling 6 tests on pid 638 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 641: [ Info: Starting test worker 1 on pid = 641, with 2 threads [ Info: Starting running test items Worker 641: 12:40:22 | maxrss 1.1% | mem 3.3% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 Worker 641: 12:40:24 | maxrss 1.1% | mem 3.3% | DONE (1/6) test item "testitem1" 1.1 secs (98.8% compile), 25.46 K allocs (1.596 MB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 641 Error in testset "testitem1" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 [ Info: Retrying "testitem1" on Worker(pid=641). Run=2. Worker 641: 12:40:27 | maxrss 1.1% | mem 3.3% | START (1/6) test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 Worker 641: 12:40:27 | maxrss 1.1% | mem 3.3% | DONE (1/6) test item "testitem1" <0.1 secs (<0.1% compile), 1.72 K allocs (116.312 KB) No Captured Logs for test item "testitem1" at test/testfiles/_junit_xml_test.jl:2 on worker 641 Error in testset "testitem1" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:4 Expression: 2 == 3 Evaluated: 2 == 3 Worker 641: 12:40:28 | maxrss 1.1% | mem 3.3% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 Worker 641: 12:40:29 | maxrss 1.1% | mem 3.3% | DONE (2/6) test item "testitem2" 0.4 secs (96.0% compile), 30.42 K allocs (2.173 MB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 641 Error in testset "inner testset" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 641: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" [ Info: Retrying "testitem2" on Worker(pid=641). Run=2. Worker 641: 12:40:30 | maxrss 1.1% | mem 3.3% | START (2/6) test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 Worker 641: 12:40:30 | maxrss 1.1% | mem 3.3% | DONE (2/6) test item "testitem2" <0.1 secs (<0.1% compile), 2.65 K allocs (164.352 KB) No Captured Logs for test item "testitem2" at test/testfiles/_junit_xml_test.jl:8 on worker 641 Error in testset "inner testset" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:11 Expression: 4 == 5 Evaluated: 4 == 5 Error in testset "inner testset" on worker 641: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:12 Expression evaluated to non-Boolean Expression: not a bool Value: "not a bool" Worker 641: 12:40:30 | maxrss 1.1% | mem 3.3% | START (3/6) test item "testitem3" at test/testfiles/_junit_xml_test.jl:17 Worker 641: 12:40:30 | maxrss 1.1% | mem 3.3% | DONE (3/6) test item "testitem3" <0.1 secs (<0.1% compile), 1.65 K allocs (112.840 KB) Worker 641: 12:40:31 | maxrss 1.1% | mem 3.3% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 Worker 641: 12:40:32 | maxrss 1.1% | mem 3.3% | DONE (4/6) test item "testitem4" 1.7 secs (96.1% compile), 434.77 K allocs (33.205 MB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 641 Error in testset "nested testset" on worker 641: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] top-level scope @ none:1 [18] eval @ ./boot.jl:385 [inlined] [19] execute @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] [20] (::ReTestItems.Workers.var"#22#23"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})() @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 [ Info: Retrying "testitem4" on Worker(pid=641). Run=2. Worker 641: 12:40:32 | maxrss 1.1% | mem 3.3% | START (4/6) test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 Worker 641: 12:40:32 | maxrss 1.1% | mem 3.3% | DONE (4/6) test item "testitem4" <0.1 secs (<0.1% compile), 6.13 K allocs (484.272 KB) No Captured Logs for test item "testitem4" at test/testfiles/_junit_xml_test.jl:23 on worker 641 Error in testset "nested testset" on worker 641: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:24 Got exception outside of a @test UndefVarError: `x` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:25 [4] eval @ ./boot.jl:385 [inlined] [5] #96 @ ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [inlined] [6] with_source_path(f::ReTestItems.var"#96#100"{Expr}, path::String) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:914 [7] (::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr})() @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1096 [8] redirect_stdio(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}; stdin::Nothing, stderr::IOContext{IOStream}, stdout::IOContext{IOStream}) @ Base ./stream.jl:1413 [9] redirect_stdio @ ./stream.jl:1376 [inlined] [10] _redirect_logs(f::ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}, target::IOStream) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:124 [11] #31 @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [12] open(::ReTestItems.var"#31#32"{ReTestItems.var"#95#99"{TestItem, String, Expr, Expr}}, ::String, ::Vararg{String}; kwargs::@Kwargs{}) @ Base ./io.jl:396 [13] open @ ./io.jl:393 [inlined] [14] _redirect_logs @ ~/.julia/packages/ReTestItems/Q6zs8/src/log_capture.jl:107 [inlined] [15] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/src/macros.jl:82 [inlined] [16] runtestitem(ti::TestItem, ctx::ReTestItems.TestContext; test_end_expr::Expr, logs::Symbol, verbose_results::Bool, finish_test::Bool, catch_test_error::Bool, failfast::Bool) @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:1093 [17] top-level scope @ none:1 [18] eval @ ./boot.jl:385 [inlined] [19] execute @ ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:334 [inlined] [20] (::ReTestItems.Workers.var"#22#23"{Sockets.TCPSocket, ReentrantLock, ReTestItems.Workers.Request})() @ ReTestItems.Workers ~/.julia/packages/ReTestItems/Q6zs8/src/workers.jl:348 Worker 641: 12:40:32 | maxrss 1.1% | mem 3.3% | START (5/6) test item "testitem5" at test/testfiles/_junit_xml_test.jl:31 Worker 641: 12:40:33 | maxrss 1.1% | mem 3.3% | DONE (5/6) test item "testitem5" <0.1 secs (90.4% compile), 2.07 K allocs (133.448 KB) Worker 641: 12:40:33 | maxrss 1.1% | mem 3.3% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 Worker 641: 12:40:33 | maxrss 1.1% | mem 3.3% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (145.008 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 641 Error in testset "testitem6" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Info: Retrying "testitem6" on Worker(pid=641). Run=2. Worker 641: 12:40:34 | maxrss 1.1% | mem 3.3% | START (6/6) test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 Worker 641: 12:40:34 | maxrss 1.1% | mem 3.3% | DONE (6/6) test item "testitem6" <0.1 secs (<0.1% compile), 2.27 K allocs (145.008 KB) No Captured Logs for test item "testitem6" at test/testfiles/_junit_xml_test.jl:40 on worker 641 Error in testset "testitem6" on worker 641: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_xml_test.jl:41 Expression: false [ Info: All tests on worker 1 completed. Closing Worker(pid=641). Worker 641: [641] signal (15): Terminated [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_LtFb45/report-ReTestItems-20250606-124023.xml" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 5 3 2 3 13 33.4s test | 5 3 2 3 13 test/testfiles | 5 3 2 3 13 test/testfiles/_junit_xml_test.jl | 5 3 2 3 13 testitem1 | 1 1 2 0.0s testitem2 | 1 1 1 3 0.0s inner testset | 1 1 2 0.0s testitem3 | 2 2 0.0s testitem4 | 1 1 0.1s nested testset | 1 1 0.0s testitem5 | 1 2 3 0.1s testitem6 | 1 1 2 0.0s nested broken | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 3 failed, 2 errored, 3 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 3.94 seconds. Scheduling 6 tests on pid 646 12:40:58 | maxrss 2.0% | mem 2.6% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 12:41:00 | maxrss 2.0% | mem 2.6% | DONE (1/6) test item "Pass on second run" 0.8 secs (98.4% compile), 11.54 K allocs (648.376 KB) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 646 Error in testset "Pass on second run" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:17 Expression: x [ Info: Retrying "Pass on second run". Run=2. 12:41:00 | maxrss 2.0% | mem 2.6% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 12:41:00 | maxrss 2.0% | mem 2.6% | DONE (1/6) test item "Pass on second run" <0.1 secs (<0.1% compile), 1.69 K allocs (121.864 KB) 12:41:00 | maxrss 2.0% | mem 2.6% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (2/6) test item "Error, then Fail, then Pass" 1.8 secs (79.6% compile, 1.3% GC), 430.35 K allocs (32.719 MB) Captured logs for test setup "StatefulSetup" (dependency of "Error, then Fail, then Pass") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 646 These are the logs for run number: 1 Error in testset "Error, then Fail, then Pass" on worker 646: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:26 Test threw exception Expression: not_defined_err UndefVarError: `not_defined_err` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:26 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:26 [ Info: Retrying "Error, then Fail, then Pass". Run=2. 12:41:02 | maxrss 2.0% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (2/6) test item "Error, then Fail, then Pass" 0.2 secs (95.7% compile), 4.76 K allocs (263.088 KB) Captured logs for test setup "StatefulSetup" (dependency of "Error, then Fail, then Pass") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 646 These are the logs for run number: 2 Error in testset "Error, then Fail, then Pass" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:28 Expression: 2 + 2 == 5 Evaluated: 4 == 5 [ Info: Retrying "Error, then Fail, then Pass". Run=3. 12:41:02 | maxrss 2.0% | mem 2.9% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (2/6) test item "Error, then Fail, then Pass" <0.1 secs (<0.1% compile), 2.20 K allocs (146.984 KB) 12:41:02 | maxrss 2.0% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 646 Error in testset "Has retries=4 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails". Run=2. 12:41:02 | maxrss 2.0% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 646 Error in testset "Has retries=4 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails". Run=3. 12:41:02 | maxrss 2.0% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 646 Error in testset "Has retries=4 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails". Run=4. 12:41:02 | maxrss 2.0% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.904 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 646 Error in testset "Has retries=4 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 Expression: false [ Info: Retrying "Has retries=4 and always fails". Run=5. 12:41:02 | maxrss 2.0% | mem 2.9% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (3/6) test item "Has retries=4 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 646 Error in testset "Has retries=4 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 Expression: false 12:41:02 | maxrss 2.0% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 646 Error in testset "Has retries=1 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:43 Expression: false [ Info: Retrying "Has retries=1 and always fails". Run=2. 12:41:02 | maxrss 2.0% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 646 Error in testset "Has retries=1 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:43 Expression: false [ Info: Retrying "Has retries=1 and always fails". Run=3. 12:41:02 | maxrss 2.0% | mem 2.9% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 12:41:02 | maxrss 2.0% | mem 2.9% | DONE (4/6) test item "Has retries=1 and always fails" <0.1 secs (<0.1% compile), 1.63 K allocs (118.600 KB) Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 646 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 646 Error in testset "Has retries=1 and always fails" on worker 646: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:43 Expression: false 12:41:02 | maxrss 2.0% | mem 2.9% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 12:41:22 | maxrss 2.0% | mem 2.9% | DONE (5/6) test item "Timeout always" 20.1 secs (0.2% compile), 20.60 K allocs (1.425 MB) 12:41:22 | maxrss 2.0% | mem 2.9% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 12:41:42 | maxrss 2.0% | mem 2.9% | DONE (6/6) test item "Timeout first, pass after" 20.1 secs (0.3% compile), 33.50 K allocs (2.412 MB) [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_TkRnuZ/report-ReTestItems-20250606-124058.xml" Test Summary: | Pass Fail Total Time ReTestItems | 4 2 6 47.3s test | 4 2 6 test/testfiles | 4 2 6 test/testfiles/_retry_tests.jl | 4 2 6 Pass on second run | 1 1 0.0s Error, then Fail, then Pass | 1 1 0.0s Has retries=4 and always fails | 1 1 0.0s Has retries=1 and always fails | 1 1 0.0s Timeout always | 1 1 20.1s Timeout first, pass after | 1 1 20.1s ERROR: Some tests did not pass: 4 passed, 2 failed, 0 errored, 0 broken. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_retry_tests.jl [ Info: Finished scanning for test items in 3.98 seconds. Scheduling 6 tests on pid 650 with 1 worker processes and 2 threads per worker. [ Info: Starting test workers Worker 653: [ Info: Starting test worker 1 on pid = 653, with 2 threads [ Info: Starting running test items Worker 653: 12:42:20 | maxrss 1.1% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 653: 12:42:21 | maxrss 1.1% | mem 3.2% | DONE (1/6) test item "Pass on second run" 0.8 secs (98.4% compile), 11.48 K allocs (643.072 KB) Worker 653: [653] signal (15): Terminated in expression starting at none:1 unknown function (ip: 0x7ec5ccedff14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 653 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 653 ┌ Error: Worker(pid=653, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=2. Worker 657: [ Info: Starting test worker on pid = 657, with 2 threads Worker 657: 12:42:33 | maxrss 1.2% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 657: 12:42:35 | maxrss 1.2% | mem 3.2% | DONE (1/6) test item "Pass on second run" 0.8 secs (98.6% compile), 11.48 K allocs (643.072 KB) Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 657 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 657 ┌ Error: Worker(pid=657, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Pass on second run" on a new worker 1 process. Run=3. Worker 661: [ Info: Starting test worker on pid = 661, with 2 threads Worker 661: 12:42:45 | maxrss 1.1% | mem 3.2% | START (1/6) test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 Worker 661: [661] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Pass on second run") at test/testfiles/_retry_tests.jl:1 on worker 661 These are the test setup logs. No Captured Logs for test item "Pass on second run" at test/testfiles/_retry_tests.jl:12 on worker 661 ┌ Error: Worker(pid=661, terminated=true, termsignal=9) timed out running test item "Pass on second run" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 665: [ Info: Starting test worker on pid = 665, with 2 threads Worker 665: 12:42:57 | maxrss 1.1% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 665 [665] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 obviously_unequal at /source/src/subtype.c:431 obviously_unequal at /source/src/subtype.c:472 obviously_unequal at /source/src/subtype.c:472 ijl_types_equal at /source/src/subtype.c:2286 jl_specializations_get_linfo_ at /source/src/gf.c:221 cache_method at /source/src/gf.c:1292 ml_matches at /source/src/gf.c:3925 ml_matches at /source/src/gf.c:3588 [inlined] ijl_matching_methods at /source/src/gf.c:2284 _methods_by_ftype at ./reflection.jl:1031 ┌ Error: Worker(pid=665, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=2. Worker 669: [ Info: Starting test worker on pid = 669, with 2 threads Worker 669: 12:43:09 | maxrss 1.1% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 669 [669] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 jl_to_typeof at /source/src/julia.h:766 [inlined] sig_match_fast at /source/src/gf.c:2914 [inlined] sig_match_fast at /source/src/gf.c:2905 [inlined] jl_lookup_generic_ at /source/src/gf.c:2995 [inlined] ijl_apply_generic at /source/src/gf.c:3073 simple_dce! at ./compiler/ssair/ir.jl:1806 ┌ Error: Worker(pid=669, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Error, then Fail, then Pass" on a new worker 1 process. Run=3. Worker 673: [ Info: Starting test worker on pid = 673, with 2 threads Worker 673: 12:43:20 | maxrss 1.2% | mem 3.2% | START (2/6) test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 Captured Logs for test item "Error, then Fail, then Pass" at test/testfiles/_retry_tests.jl:20 on worker 673 [673] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:25 ┌ Error: Worker(pid=673, terminated=true, termsignal=9) timed out running test item "Error, then Fail, then Pass" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 677: [ Info: Starting test worker on pid = 677, with 2 threads Worker 677: 12:43:32 | maxrss 1.1% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 677: [677] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 677 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 677 ┌ Error: Worker(pid=677, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=2. Worker 681: [ Info: Starting test worker on pid = 681, with 2 threads Worker 681: 12:43:44 | maxrss 1.1% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 681: [681] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 681 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 681 ┌ Error: Worker(pid=681, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=3. Worker 685: [ Info: Starting test worker on pid = 685, with 2 threads Worker 685: 12:43:56 | maxrss 1.1% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 685 These are the test setup logs. Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 685 [685] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:37 ┌ Error: Worker(pid=685, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=4. Worker 689: [ Info: Starting test worker on pid = 689, with 2 threads Worker 689: 12:44:07 | maxrss 1.2% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 689: [689] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 689 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 689 ┌ Error: Worker(pid=689, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=4 and always fails" on a new worker 1 process. Run=5. Worker 693: [ Info: Starting test worker on pid = 693, with 2 threads Worker 693: 12:44:19 | maxrss 1.1% | mem 3.2% | START (3/6) test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 Worker 693: [693] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=4 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 693 These are the test setup logs. No Captured Logs for test item "Has retries=4 and always fails" at test/testfiles/_retry_tests.jl:34 on worker 693 ┌ Error: Worker(pid=693, terminated=true, termsignal=9) timed out running test item "Has retries=4 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 697: [ Info: Starting test worker on pid = 697, with 2 threads Worker 697: 12:44:30 | maxrss 1.2% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 697 These are the test setup logs. Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 697 [697] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:43 ┌ Error: Worker(pid=697, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=2. Worker 701: [ Info: Starting test worker on pid = 701, with 2 threads Worker 701: 12:44:42 | maxrss 1.1% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 701: [701] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 701 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 701 ┌ Error: Worker(pid=701, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Has retries=1 and always fails" on a new worker 1 process. Run=3. Worker 705: [ Info: Starting test worker on pid = 705, with 2 threads Worker 705: 12:44:54 | maxrss 1.1% | mem 3.2% | START (4/6) test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 Worker 705: [705] signal (15): Terminated Captured logs for test setup "StatefulSetup" (dependency of "Has retries=1 and always fails") at test/testfiles/_retry_tests.jl:1 on worker 705 These are the test setup logs. No Captured Logs for test item "Has retries=1 and always fails" at test/testfiles/_retry_tests.jl:40 on worker 705 ┌ Error: Worker(pid=705, terminated=true, termsignal=9) timed out running test item "Has retries=1 and always fails" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 709: [ Info: Starting test worker on pid = 709, with 2 threads Worker 709: 12:45:05 | maxrss 1.1% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 709 [709] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x71b66301ef14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=709, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=2. Worker 713: [ Info: Starting test worker on pid = 713, with 2 threads Worker 713: 12:45:17 | maxrss 1.1% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 713 [713] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7259cbe36f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=713, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout always" on a new worker 1 process. Run=3. Worker 717: [ Info: Starting test worker on pid = 717, with 2 threads Worker 717: 12:45:29 | maxrss 1.1% | mem 3.2% | START (5/6) test item "Timeout always" at test/testfiles/_retry_tests.jl:54 Captured Logs for test item "Timeout always" at test/testfiles/_retry_tests.jl:54 on worker 717 [717] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:60 unknown function (ip: 0x7e78f453df14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=717, terminated=true, termsignal=9) timed out running test item "Timeout always" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 Worker 721: [ Info: Starting test worker on pid = 721, with 2 threads Worker 721: 12:45:41 | maxrss 1.1% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 721 [721] signal (15): Terminated in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_retry_tests.jl:71 unknown function (ip: 0x7e3815300f14) pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 ijl_task_get_next at /source/src/partr.c:517 poptask at ./task.jl:999 wait at ./task.jl:1008 #wait#647 at ./condition.jl:130 wait at ./condition.jl:125 [inlined] _trywait at ./asyncevent.jl:142 wait at ./asyncevent.jl:159 [inlined] sleep at ./asyncevent.jl:265 ┌ Error: Worker(pid=721, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=2. Worker 725: [ Info: Starting test worker on pid = 725, with 2 threads Worker 725: 12:45:53 | maxrss 1.1% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 725: 12:45:54 | maxrss 1.1% | mem 3.2% | DONE (6/6) test item "Timeout first, pass after" 1.0 secs (98.3% compile), 73.90 K allocs (5.120 MB) Worker 725: [725] signal (15): Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 725 ┌ Error: Worker(pid=725, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: Retrying "Timeout first, pass after" on a new worker 1 process. Run=3. Worker 729: [ Info: Starting test worker on pid = 729, with 2 threads Worker 729: 12:46:04 | maxrss 1.1% | mem 3.2% | START (6/6) test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 Worker 729: 12:46:06 | maxrss 1.1% | mem 3.2% | DONE (6/6) test item "Timeout first, pass after" 1.0 secs (98.3% compile), 73.90 K allocs (5.120 MB) Worker 729: [729] signal (15): Terminated No Captured Logs for test item "Timeout first, pass after" at test/testfiles/_retry_tests.jl:64 on worker 729 ┌ Error: Worker(pid=729, terminated=true, termsignal=9) timed out running test item "Timeout first, pass after" after 5 seconds. Recording test error. └ @ ReTestItems ~/.julia/packages/ReTestItems/Q6zs8/src/ReTestItems.jl:666 [ Info: All tests on worker 1 completed. Closing Worker(pid=729, terminated=true, termsignal=9). [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_b5wtd6/report-ReTestItems-20250606-124222.xml" Test Summary: | Error Total Time ReTestItems | 6 6 4m07.0s test | 6 6 test/testfiles | 6 6 test/testfiles/_retry_tests.jl | 6 6 Pass on second run | 1 1 5.0s Error, then Fail, then Pass | 1 1 5.0s Has retries=4 and always fails | 1 1 5.0s Has retries=1 and always fails | 1 1 5.0s Timeout always | 1 1 5.0s Timeout first, pass after | 1 1 5.0s ERROR: Some tests did not pass: 0 passed, 0 failed, 6 errored, 0 broken. ┌ Warning: Reference and comparison files do not match │ reference = "/home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/references/retry_tests_report_1worker.xml" │ comparison = "/tmp/jl_b5wtd6/report-ReTestItems-20250606-124222.xml" └ @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:57 """ - - - \t + + + \t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t - \t\tError in testset \"Pass on second run\" on worker 0: - Test Failed at path/to/testfiles/_retry_tests.jl:17 - Expression: x + \t\tError in testset \"Pass on second run\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:12 + Got exception outside of a @test + Timed out after 5s running test item \"Pass on second run\" (run=1) Captured logs for test setup \"StatefulSetup\" (dependency of \"Pass on second run\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 These are the test setup logs. No Captured Logs for test item \"Pass on second run\" at path/to/testfiles/_retry_tests.jl:12 on worker 0 \t\t \t - \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Pass on second run\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:12 + Got exception outside of a @test + Timed out after 5s running test item \"Pass on second run\" (run=2) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Pass on second run\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Pass on second run\" at path/to/testfiles/_retry_tests.jl:12 on worker 0 + \t\t + \t + \t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t + \t\tError in testset \"Pass on second run\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:12 + Got exception outside of a @test + Timed out after 5s running test item \"Pass on second run\" (run=3) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Pass on second run\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Pass on second run\" at path/to/testfiles/_retry_tests.jl:12 on worker 0 + \t\t \t \t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t - \t\tError in testset \"Error, then Fail, then Pass\" on worker 0: - Error During Test at path/to/testfiles/_retry_tests.jl:26 - Test threw exception - Expression: not_defined_err - UndefVarError: not_defined_err not defined - Stacktrace: - [omitted] + \t\tError in testset \"Error, then Fail, then Pass\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:20 + Got exception outside of a @test + Timed out after 5s running test item \"Error, then Fail, then Pass\" (run=1) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Error, then Fail, then Pass\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + Captured Logs for test item \"Error, then Fail, then Pass\" at path/to/testfiles/_retry_tests.jl:20 on worker 0 + [665] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:25 + obviously_unequal at /source/src/subtype.c:431 + obviously_unequal at /source/src/subtype.c:472 + obviously_unequal at /source/src/subtype.c:472 + ijl_types_equal at /source/src/subtype.c:2286 + jl_specializations_get_linfo_ at /source/src/gf.c:221 + cache_method at /source/src/gf.c:1292 + ml_matches at /source/src/gf.c:3925 + ml_matches at /source/src/gf.c:3588 [inlined] + ijl_matching_methods at /source/src/gf.c:2284 + _methods_by_ftype at ./reflection.jl:1031 \t\t \t - \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Error, then Fail, then Pass\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:20 + Got exception outside of a @test + Timed out after 5s running test item \"Error, then Fail, then Pass\" (run=2) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Error, then Fail, then Pass\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + Captured Logs for test item \"Error, then Fail, then Pass\" at path/to/testfiles/_retry_tests.jl:20 on worker 0 + [669] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:25 + jl_to_typeof at /source/src/julia.h:766 [inlined] + sig_match_fast at /source/src/gf.c:2914 [inlined] + sig_match_fast at /source/src/gf.c:2905 [inlined] + jl_lookup_generic_ at /source/src/gf.c:2995 [inlined] + ijl_apply_generic at /source/src/gf.c:3073 + simple_dce! at ./compiler/ssair/ir.jl:1806 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Error, then Fail, then Pass\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:20 + Got exception outside of a @test + Timed out after 5s running test item \"Error, then Fail, then Pass\" (run=3) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Error, then Fail, then Pass\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + Captured Logs for test item \"Error, then Fail, then Pass\" at path/to/testfiles/_retry_tests.jl:20 on worker 0 + [673] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:25 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=4 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:34 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=4 and always fails\" (run=1) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=4 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=4 and always fails\" at path/to/testfiles/_retry_tests.jl:34 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=4 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:34 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=4 and always fails\" (run=2) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=4 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=4 and always fails\" at path/to/testfiles/_retry_tests.jl:34 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=4 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:34 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=4 and always fails\" (run=3) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=4 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + Captured Logs for test item \"Has retries=4 and always fails\" at path/to/testfiles/_retry_tests.jl:34 on worker 0 + [685] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:37 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=4 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:34 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=4 and always fails\" (run=4) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=4 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=4 and always fails\" at path/to/testfiles/_retry_tests.jl:34 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=4 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:34 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=4 and always fails\" (run=5) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=4 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=4 and always fails\" at path/to/testfiles/_retry_tests.jl:34 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=1 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:40 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=1 and always fails\" (run=1) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=1 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + Captured Logs for test item \"Has retries=1 and always fails\" at path/to/testfiles/_retry_tests.jl:40 on worker 0 + [697] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:43 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=1 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:40 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=1 and always fails\" (run=2) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=1 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=1 and always fails\" at path/to/testfiles/_retry_tests.jl:40 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Has retries=1 and always fails\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:40 + Got exception outside of a @test + Timed out after 5s running test item \"Has retries=1 and always fails\" (run=3) + Captured logs for test setup \"StatefulSetup\" (dependency of \"Has retries=1 and always fails\") at path/to/testfiles/_retry_tests.jl:1 on worker 0 + These are the test setup logs. + No Captured Logs for test item \"Has retries=1 and always fails\" at path/to/testfiles/_retry_tests.jl:40 on worker 0 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Timeout always\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:54 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout always\" (run=1) + Captured Logs for test item \"Timeout always\" at path/to/testfiles/_retry_tests.jl:54 on worker 0 + [709] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:60 + unknown function (ip: 0x71b66301ef14) + pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) + uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 + ijl_task_get_next at /source/src/partr.c:517 + poptask at ./task.jl:999 + wait at ./task.jl:1008 + #wait#647 at ./condition.jl:130 + wait at ./condition.jl:125 [inlined] + _trywait at ./asyncevent.jl:142 + wait at ./asyncevent.jl:159 [inlined] + sleep at ./asyncevent.jl:265 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Timeout always\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:54 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout always\" (run=2) + Captured Logs for test item \"Timeout always\" at path/to/testfiles/_retry_tests.jl:54 on worker 0 + [713] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:60 + unknown function (ip: 0x7259cbe36f14) + pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) + uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 + ijl_task_get_next at /source/src/partr.c:517 + poptask at ./task.jl:999 + wait at ./task.jl:1008 + #wait#647 at ./condition.jl:130 + wait at ./condition.jl:125 [inlined] + _trywait at ./asyncevent.jl:142 + wait at ./asyncevent.jl:159 [inlined] + sleep at ./asyncevent.jl:265 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Timeout always\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:54 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout always\" (run=3) + Captured Logs for test item \"Timeout always\" at path/to/testfiles/_retry_tests.jl:54 on worker 0 + [717] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:60 + unknown function (ip: 0x7e78f453df14) + pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) + uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 + ijl_task_get_next at /source/src/partr.c:517 + poptask at ./task.jl:999 + wait at ./task.jl:1008 + #wait#647 at ./condition.jl:130 + wait at ./condition.jl:125 [inlined] + _trywait at ./asyncevent.jl:142 + wait at ./asyncevent.jl:159 [inlined] + sleep at ./asyncevent.jl:265 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Timeout first, pass after\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:64 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout first, pass after\" (run=1) + Captured Logs for test item \"Timeout first, pass after\" at path/to/testfiles/_retry_tests.jl:64 on worker 0 + [721] signal (15): Terminated + in expression starting at path/to/testfiles/_retry_tests.jl:71 + unknown function (ip: 0x7e3815300f14) + pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) + uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:883 + ijl_task_get_next at /source/src/partr.c:517 + poptask at ./task.jl:999 + wait at ./task.jl:1008 + #wait#647 at ./condition.jl:130 + wait at ./condition.jl:125 [inlined] + _trywait at ./asyncevent.jl:142 + wait at ./asyncevent.jl:159 [inlined] + sleep at ./asyncevent.jl:265 + \t\t + \t + \t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\t + \t\tError in testset \"Timeout first, pass after\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:64 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout first, pass after\" (run=2) + No Captured Logs for test item \"Timeout first, pass after\" at path/to/testfiles/_retry_tests.jl:64 on worker 0 + \t\t + \t + \t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t \t\t + \t\tError in testset \"Timeout first, pass after\" on worker 0: + Error During Test at path/to/testfiles/_retry_tests.jl:64 + Got exception outside of a @test + Timed out after 5s running test item \"Timeout first, pass after\" (run=3) + No Captured Logs for test item \"Timeout first, pass after\" at path/to/testfiles/_retry_tests.jl:64 on worker 0 + \t\t \t """ Correct logs for each retry, nworkers=1: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:69 Expression: :reference == :comparison Evaluated: reference == comparison Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined] [2] test_reference(reference::String, comparison::String) @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:69 [3] (::var"#464#481"{String, String, Int64})() @ Main ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:127 [4] withenv(::var"#464#481"{String, String, Int64}, ::Pair{String, String}, ::Vararg{Pair{String}}) @ Base ./env.jl:257 [5] #463 @ ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:107 [inlined] [6] mktempdir(fn::var"#463#480"{String, Int64}, parent::String; prefix::String) @ Base.Filesystem ./file.jl:766 [7] mktempdir(fn::Function, parent::String) @ Base.Filesystem ./file.jl:762 [8] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:106 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1669 [inlined] [10] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:105 [inlined] [11] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [12] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:79 [inlined] [13] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined] [14] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/junit_xml.jl:78 Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_skip_tests.jl [ Info: Finished scanning for test items in 3.91 seconds. Scheduling 6 tests on pid 734 12:46:28 | maxrss 2.0% | mem 2.6% | START (1/6) test item "no skip, 1 pass" at test/testfiles/_skip_tests.jl:2 12:46:29 | maxrss 2.0% | mem 2.6% | DONE (1/6) test item "no skip, 1 pass" 0.8 secs (98.8% compile), 29.64 K allocs (1.951 MB) 12:46:29 | maxrss 2.0% | mem 2.6% | START (2/6) test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 12:46:30 | maxrss 2.0% | mem 2.6% | DONE (2/6) test item "skip false, 1 pass, 1 fail" <0.1 secs (<0.1% compile), 1.60 K allocs (111.424 KB) No Captured Logs for test item "skip false, 1 pass, 1 fail" at test/testfiles/_skip_tests.jl:6 on worker 734 Error in testset "skip false, 1 pass, 1 fail" on worker 734: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_skip_tests.jl:8 Expression: false 12:46:30 | maxrss 2.0% | mem 2.6% | SKIP (3/6) test item "skip true" at test/testfiles/_skip_tests.jl:11 12:46:30 | maxrss 2.0% | mem 2.6% | START (4/6) test item "skip expr false, 2 pass" at test/testfiles/_skip_tests.jl:16 12:46:30 | maxrss 2.0% | mem 2.6% | DONE (4/6) test item "skip expr false, 2 pass" <0.1 secs (<0.1% compile), 1.60 K allocs (110.616 KB) 12:46:30 | maxrss 2.0% | mem 2.6% | SKIP (5/6) test item "skip expr true" at test/testfiles/_skip_tests.jl:21 12:46:30 | maxrss 2.0% | mem 2.6% | SKIP (6/6) test item "skip expr block true" at test/testfiles/_skip_tests.jl:25 [ Tests Completed: 6/6 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_4R2CVf/report-ReTestItems-20250606-124628.xml" Test Summary: | Pass Fail Broken Total Time ReTestItems | 4 1 3 8 4.4s test | 4 1 3 8 test/testfiles | 4 1 3 8 test/testfiles/_skip_tests.jl | 4 1 3 8 no skip, 1 pass | 1 1 0.8s skip false, 1 pass, 1 fail | 1 1 2 0.0s skip true | 1 1 skip expr false, 2 pass | 2 2 0.0s skip expr true | 1 1 skip expr block true | 1 1 ERROR: Some tests did not pass: 4 passed, 1 failed, 0 errored, 3 broken. [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_Ry6YBs/report-ReTestItems-20250606-124632.xml" [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_tV0AY1/report-ReTestItems-20250606-124632.xml" [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_empty_file_test.jl [ Info: Finished scanning for test items in 0.01 seconds. Scheduling 0 tests on pid 12 [ Tests Completed: 0/0 test items were run. Activating project at `~/.julia/packages/ReTestItems/Q6zs8` [ Info: Scanning for test items in project `ReTestItems` at paths: testfiles/_junit_error_message_test.jl [ Info: Finished scanning for test items in 3.85 seconds. Scheduling 3 tests on pid 741 12:46:53 | maxrss 2.0% | mem 2.6% | START (1/3) test item "testitem with one fail" at test/testfiles/_junit_error_message_test.jl:1 12:46:55 | maxrss 2.0% | mem 2.6% | DONE (1/3) test item "testitem with one fail" 1.2 secs (97.9% compile), 55.20 K allocs (3.770 MB) No Captured Logs for test item "testitem with one fail" at test/testfiles/_junit_error_message_test.jl:1 on worker 741 Error in testset "testitem with one fail" on worker 741: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:2 Expression: false 12:46:56 | maxrss 2.0% | mem 2.6% | START (2/3) test item "testitem with one error" at test/testfiles/_junit_error_message_test.jl:11 12:46:58 | maxrss 2.0% | mem 2.8% | DONE (2/3) test item "testitem with one error" 2.3 secs (80.4% compile, 0.6% GC), 427.35 K allocs (32.474 MB) No Captured Logs for test item "testitem with one error" at test/testfiles/_junit_error_message_test.jl:11 on worker 741 Error in testset "testitem with one error" on worker 741: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:12 Test threw exception Expression: X + Y UndefVarError: `X` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:12 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:12 12:46:58 | maxrss 2.0% | mem 2.8% | START (3/3) test item "testitem with error and failure" at test/testfiles/_junit_error_message_test.jl:21 12:46:58 | maxrss 2.0% | mem 2.8% | DONE (3/3) test item "testitem with error and failure" 0.2 secs (<0.1% compile), 4.30 K allocs (268.168 KB) No Captured Logs for test item "testitem with error and failure" at test/testfiles/_junit_error_message_test.jl:21 on worker 741 Error in testset "testitem with error and failure" on worker 741: Error During Test at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:22 Test threw exception Expression: X + Y UndefVarError: `X` not defined Stacktrace: [1] macro expansion @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:22 [inlined] [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.10/Test/src/Test.jl:669 [inlined] [3] top-level scope @ ~/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:22 Error in testset "fail 1" on worker 741: Test Failed at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/testfiles/_junit_error_message_test.jl:27 Expression: false [ Tests Completed: 3/3 test items were run. [ Info: Writing JUnit XML file to "/tmp/jl_Ly8xGA/report-ReTestItems-20250606-124654.xml" Test Summary: | Pass Fail Error Total Time ReTestItems | 5 2 2 9 7.5s test | 5 2 2 9 test/testfiles | 5 2 2 9 test/testfiles/_junit_error_message_test.jl | 5 2 2 9 testitem with one fail | 2 1 3 1.2s pass 1 | 1 1 0.1s pass 2 | 1 1 0.0s testitem with one error | 2 1 3 2.3s pass 1 | 1 1 0.0s pass 2 | 1 1 0.0s testitem with error and failure | 1 1 1 3 0.2s pass 1 | 1 1 0.0s fail 1 | 1 1 0.0s ERROR: Some tests did not pass: 5 passed, 2 failed, 2 errored, 0 broken. [ Info: Writing JUnit XML file to "/tmp/jl_abY2H5" [ Info: Writing JUnit XML file to "/tmp/jl_Q86pCI" Test Summary: | Pass Fail Error Broken Total Time ReTestItems | 1720 45 2 3 1770 40m07.2s workers.jl | 35 5 40 53.2s correct connected/running states (Worker(pid=15)) | 7 7 1.5s clean shutdown (Worker(pid=15)) | 6 6 2.1s more forceful shutdown (Worker(pid=18)) | 7 7 0.3s remote_eval/remote_fetch (Worker(pid=21)) | 5 5 3.6s worker crashing (Worker(pid=24)) | 7 7 2.2s remote_eval (Worker(pid=27)) | 2 2 3.7s CPU profile | 1 5 6 23.0s internals.jl | 435 435 11.4s get_starting_testitems | 300 300 2.4s is_test_file | 20 20 0.0s is_testsetup_file | 5 5 0.0s _is_subproject | 7 7 0.2s include_testfiles! | 18 18 4.9s report_empty_testsets | 6 6 2.3s JUnit _error_message | 2 2 0.2s _validated_nworker_threads | 19 19 0.1s _validated_paths | 13 13 0.3s skiptestitem | 4 4 0.5s should_skip | 8 8 0.4s filtering.jl | 21 21 0.2s nestedrelpath | 12 12 0.0s macros.jl | 98 98 10.8s testsetup macro basic | 1 1 0.0s testitem macro basic | 4 4 2.0s testitem with `tags` | 3 3 0.1s testitem with `retries` | 3 3 0.1s testitem with macro import | 2 2 1.5s testitem with `setup` | 5 5 0.5s testsetup and testitem with includes | 3 3 0.3s missing testsetup | 1 1 2.4s testitem with duplicate keywords | 1 1 0.4s can identity if in a `@testitem` | 2 2 0.1s testitem macro runs immediately outside `runtests` | 6 6 1.0s manually specify `source` location | 4 4 0.0s testsetup not given module | 2 2 1.0s testitem `_id` keyword | 6 6 0.6s testitem `timeout` keyword | 8 8 0.5s testitem `skip` keyword | 34 34 0.2s tesitem `failfast` keyword | 2 2 0.1s testitem with `default_imports` | 6 6 0.0s testitem with unrecognised keyword | 1 1 0.0s testitem without a body | 4 4 0.0s integrationtests.jl | 359 39 2 3 403 28m53.7s manual `runtests(dir)` | 2 2 8.8s manual `runtests(file)` | 2 2 0.2s `runtests(path)` auto finds testsetups | 3 3 7.0s Warn or error when not test file | 11 11 2.8s filter `runtests(func, x)` | 13 13 8.2s `@testitem` scoping rules | 1 1 0.3s single-process | 14 1 15 2m18.8s Pkg.test() NoDeps.jl | 1 1 20.2s Pkg.test() TestsInSrc.jl | 1 1 18.6s Pkg.test() TestProjectFile.jl | 1 1 20.1s Pkg.test() TestEndExpr.jl | 1 1 42.5s Pkg.test() DontPass.jl | 1 1 29.4s runtests() NoDeps.jl | 2 2 0.2s runtests() TestsInSrc.jl | 2 2 0.1s runtests() TestProjectFile.jl | 2 2 0.5s runtests() TestEndExpr.jl | 1 1 0.0s runtests() DontPass.jl | 3 3 7.2s runtests a dir with 0 nworkers but worker_init_expr set | 2 2 0.6s runtests with nworkers = 2 | 10 10 4m18.6s Pkg.test() NoDeps.jl | 2 2 54.2s Pkg.test() TestsInSrc.jl | 2 2 53.2s Pkg.test() TestProjectFile.jl | 2 2 43.7s Pkg.test() TestEndExpr.jl | 2 2 39.1s Pkg.test() DontPass.jl | 2 2 1m08.4s don't recurse into subpackages | 2 2 3.0s trigger subpackage tests | 3 3 18.8s passing file (not dir) | 1 1 0.1s passing multiple files/dirs | 4 4 2.4s print report sorted | 2 2 0.8s `verbose_results`, `debug` and `logs` keywords | 48 48 1.0s `report=true` is not compatible with `logs=:eager` | 1 1 0.1s filter `runtests(x; tags)` | 8 8 3.7s filter `runtests(x; name)` | 7 7 3.5s filter `runtests(x; name, tags)` | 7 7 4.6s filter `runtests(func, x; name, tags)` | 8 8 7.3s Warn on empty test set -- integration test | 3 3 0.1s log capture for an errored TestSetup | 2 2 4 19.9s test crashing testitem | 4 4 25.6s test retrying failing testitem | 3 5 8 3m45.5s bugfix: `runtests` in a testset | 2 2 0.8s testitem_timeout | 1 1 1 3 21.3s testitem_timeout set via env variable | 1 1 1 3 22.6s @testitem `timeout` | 12 12 38.9s Error outside `@testitem` | 2 2 0.0s `runtests` finds no testitems | 2 2 0.1s Worker log capture on a failing test is not reported twice | 1 1 14.0s Worker and nworker_threads argument | 1 1 13.4s _redirect_logs and custom loggers | 1 1 0.3s error on code outside `@testitem`/`@testsetup` | 10 10 2.0s Duplicate names in same file throws | 2 2 0.2s Duplicate names in different files allowed | 2 2 12.6s Duplicate IDs not allowed | 2 2 0.0s Timeout failures accurately record elapsed time | 1 1 19.9s CPU profile timeout trigger | 14 2 16 2m52.6s timeout_profile_wait=0 means no CPU profile | 1 1 20.8s non-zero timeout_profile_wait means we collect a CPU profile | 2 1 3 29.7s `set_peek_duration` is respected in `worker_init_expr` | 3 3 32.7s RETESTITEMS_TIMEOUT_PROFILE_WAIT environment variable | 2 1 3 29.3s CPU profile with :eager | 3 3 30.3s CPU profile with :batched | 3 3 29.6s worker always crashes immediately | 4 4 39.5s worker crashes immediately but succeeds on retry | 3 3 30.7s test_end_expr | 21 3 24 2m12.4s nworkers=0 | 5 5 0.4s nworkers=1 | 5 5 27.2s nworkers=2 | 5 5 49.2s report printing | 2 3 5 26.8s TestEndExpr.jl package | 4 4 28.9s test_end_expr always runs, even if testitem throws | 2 2 3.2s Replace workers when we hit memory threshold | 7 7 1m50.6s skipping testitems | 1 1 18.4s logs are aligned | 3 3 0.3s ParseError in test file | 2 2 1.1s invalid testitem combined with filter function | 24 24 0.2s error code from running `@testitem` directly | 1 1 10.1s runtests `failfast` keyword | 44 24 2 70 5m22.6s failure | 12 6 18 1m15.8s nworkers=0 | 6 6 0.3s nworkers=1 | 2 4 6 24.3s nworkers=3 | 4 2 6 51.1s error | 12 6 18 1m15.0s nworkers=0 | 6 6 0.7s nworkers=1 | 2 4 6 24.4s nworkers=3 | 4 2 6 49.9s timeout | 6 6 1 13 1m12.6s nworkers=0 | 1 1 0.0s nworkers=1 | 2 4 6 24.1s nworkers=3 | 4 2 6 48.5s crash | 6 6 1 13 1m12.9s nworkers=0 | 1 1 0.0s nworkers=1 | 2 4 6 24.1s nworkers=3 | 4 2 6 48.8s multiple failures | 5 5 26.0s ENV var | 3 3 0.3s Handle `@testset failfast=true` | 3 3 0.2s DONE time reported when testitem throws | 2 2 1.1s runtests `testitem_failfast` keyword | 27 27 2.8s `test_end_expr` must be `:block` | 1 1 0.1s log_capture.jl | 52 52 50.9s log capture | 3 3 39.6s Workers print in color | 1 1 10.6s log capture -- reporting | 12 12 0.2s default_log_display_mode | 20 20 0.0s print_time | 16 16 0.5s junit_xml.jl | 50 1 51 8m50.6s JUnit reference tests | 6 1 7 8m21.1s retries=0, nworkers=0 | 1 1 26.0s retries=0, nworkers=1 | 1 1 45.8s retries=1, nworkers=0 | 1 1 24.8s retries=1, nworkers=1 | 1 1 51.7s Correct logs for each retry, nworkers=0 | 1 1 1m05.0s Correct logs for each retry, nworkers=1 | 1 1 4m25.1s skipped testitems | 1 1 22.7s JUnit empty report | 1 1 0.4s Respect `RETESTITEMS_REPORT` | 2 2 0.2s Set error message appropriately | 16 16 27.8s JUnit properties / DataDog tags | 12 12 0.1s Manual JUnitTestSuite/JUnitTestCase | 9 9 0.6s Manual JUnitTestSuite/JUnitTestCase with error no logs | 4 4 0.3s tests removed workers | 690 690 0.0s ERROR: LoadError: Some tests did not pass: 1720 passed, 45 failed, 2 errored, 3 broken. in expression starting at /home/pkgeval/.julia/packages/ReTestItems/Q6zs8/test/runtests.jl:13 Testing failed after 2319.07s ERROR: LoadError: Package ReTestItems errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Types.jl:70 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:2034 [3] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/Operations.jl:1915 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{Pkg.Types.PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::Base.PipeEndpoint}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:444 [5] test(pkgs::Vector{Pkg.Types.PackageSpec}; io::Base.PipeEndpoint, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:159 [6] test @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:147 [inlined] [7] #test#74 @ /opt/julia/share/julia/stdlib/v1.10/Pkg/src/API.jl:146 [inlined] [8] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 2442.79s: package is using an unknown package