Package evaluation to test DistributedNext on Julia 1.12.7-DEV.42 (6f510b6086*) started at 2026-06-19T11:27:16.673 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 7.96s ################################################################################ # Installation # Installing DistributedNext... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [fab6aee4] + DistributedNext v1.3.1 Updating `~/.julia/environments/v1.12/Manifest.toml` [fab6aee4] + DistributedNext v1.3.1 [076d061b] + HashArrayMappedTries v0.2.0 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [7e506255] + ScopedValues v1.6.2 [ade2ca70] + Dates v1.11.0 [56ddb016] + Logging v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [6462fe0b] + Sockets v1.11.0 [fa267f1f] + TOML v1.0.3 [4ec0a83e] + Unicode v1.11.0 Installation completed after 1.19s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 1468.6 ms ✓ libssh_jll 3814.8 ms ✓ Revise → DistributedExt 45656.7 ms ✓ DistributedNext → ReviseExt 7177.0 ms ✓ LibSSH 4 dependencies successfully precompiled in 59 seconds. 51 already precompiled. 24 dependencies precompiled but different versions are currently loaded (ArgTools, Base64, Dates, Downloads, JuliaSyntaxHighlighting, LibCURL, LibCURL_jll, LibGit2, LibGit2_jll, LibSSH2_jll, Logging, Markdown, MozillaCACerts_jll, NetworkOptions, OpenSSL_jll, Pkg, Printf, StyledStrings, TOML, Tar, UUIDs, Zlib_jll, nghttp2_jll and p7zip_jll). Restart julia to access the new versions. Otherwise, 21 dependents of these packages may trigger further precompilation to work with the unexpected versions. Precompilation completed after 72.74s ################################################################################ # Testing # Testing DistributedNext Status `/tmp/jl_dA9Aps/Project.toml` [4c88cf16] Aqua v0.8.16 [fab6aee4] DistributedNext v1.3.1 [00483490] LibSSH v0.7.1 [aea7be01] PrecompileTools v1.3.4 [295af30f] Revise v3.15.1 [7e506255] ScopedValues v1.6.2 [8ba89e20] Distributed v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [9a3f8284] Random v1.11.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_dA9Aps/Manifest.toml` [4c88cf16] Aqua v0.8.16 [fa961155] CEnum v0.5.0 [da1fd8a2] CodeTracking v3.0.2 [34da2185] Compat v4.18.1 [807dbc54] Compiler v0.1.1 [fab6aee4] DistributedNext v1.3.1 [ffbed154] DocStringExtensions v0.9.5 [076d061b] HashArrayMappedTries v0.2.0 [692b3bcd] JLLWrappers v1.8.0 [aa1ae85d] JuliaInterpreter v0.10.12 [00483490] LibSSH v0.7.1 [6f1432cf] LoweredCodeUtils v3.6.0 [bac558e1] OrderedCollections v2.0.0 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [295af30f] Revise v3.15.1 [7e506255] ScopedValues v1.6.2 [b39eb1a6] Kerberos_krb5_jll v1.21.3+0 [a8d4f100] libssh_jll v0.11.4+0 [0dad84c5] ArgTools v1.1.2 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [8bf52ea8] CRC32c v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [f43a241f] Downloads v1.7.0 [7b1f6079] FileWatching v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [b27032c2] LibCURL v0.6.4 [76f85450] LibGit2 v1.11.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [ca575930] NetworkOptions v1.3.0 [44cfe95a] Pkg v1.12.1 [de0858da] Printf v1.11.0 [3fa0cd96] REPL v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [6462fe0b] Sockets v1.11.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [a4e569a6] Tar v1.10.0 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [deac9b47] LibCURL_jll v8.15.0+0 [e37daf67] LibGit2_jll v1.9.0+0 [29816b5a] LibSSH2_jll v1.11.3+1 [14a3606d] MozillaCACerts_jll v2025.11.4 [4536629a] OpenBLAS_jll v0.3.29+0 [458c3c95] OpenSSL_jll v3.5.6+0 [83775a58] Zlib_jll v1.3.1+2 [8e850b90] libblastrampoline_jll v5.15.0+0 [8e850ede] nghttp2_jll v1.64.0+1 [3f19e933] p7zip_jll v17.7.0+0 Testing Running tests... Precompiling packages... 1696.9 ms ✓ Kerberos_krb5_jll 1438.3 ms ✓ libssh_jll 6806.3 ms ✓ LibSSH 3 dependencies successfully precompiled in 10 seconds. 10 already precompiled. 4 dependencies precompiled but different versions are currently loaded (Dates, Preferences, Printf and TOML). Restart julia to access the new versions. Otherwise, 4 dependents of these packages may trigger further precompilation to work with the unexpected versions. Testing SSH addprocs with 9 workers... ┌ Error: Exception launching on machine 127.0.0.1 │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 127.0.0.1 "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 ┌ Error: Exception launching on machine 128.30.92.239 │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 128.30.92.239 "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 ┌ Error: Exception launching on machine localhost │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 localhost "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 SSHManager: Test Failed at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:51 Expression: length(new_pids) == length(hosts) Evaluated: 0 == 9 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [2] (::var"#14#15"{UInt16})() @ Main ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:51 [3] (::LibSSH.Demo.var"#11#12"{var"#14#15"{UInt16}, Vector{Test.AbstractTestSet}, Timer})() @ LibSSH.Demo ~/.julia/packages/LibSSH/a57Hc/src/server.jl:868 Mixed ssh addprocs with :auto ┌ Error: Exception launching on machine 127.0.0.1 │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 127.0.0.1 "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Symbol, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Symbol})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 ┌ Error: Exception launching on machine localhost │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 localhost "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 SSHManager: Test Failed at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:56 Expression: length(new_pids) == 2 + Sys.CPU_THREADS Evaluated: 0 == 3 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [2] (::var"#14#15"{UInt16})() @ Main ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:56 [3] (::LibSSH.Demo.var"#11#12"{var"#14#15"{UInt16}, Vector{Test.AbstractTestSet}, Timer})() @ LibSSH.Demo ~/.julia/packages/LibSSH/a57Hc/src/server.jl:868 Mixed ssh addprocs with numeric counts ┌ Error: Exception launching on machine 127.0.0.1 │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 127.0.0.1 "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 ┌ Error: Exception launching on machine localhost │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 localhost "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia '\''--project=/tmp/jl_dA9Aps/Project.toml'\'' -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 SSHManager: Test Failed at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:61 Expression: length(new_pids) == 5 Evaluated: 0 == 5 Stacktrace: [1] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] [2] (::var"#14#15"{UInt16})() @ Main ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:61 [3] (::LibSSH.Demo.var"#11#12"{var"#14#15"{UInt16}, Vector{Test.AbstractTestSet}, Timer})() @ LibSSH.Demo ~/.julia/packages/LibSSH/a57Hc/src/server.jl:868 ssh addprocs with a port hint ┌ Error: Exception launching on machine localhost 127.0.0.1:[8000] │ exception = │ IOError: could not spawn `ssh -T -a -x -o ClearAllForwardings=yes -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR -p 2222 localhost "sh -l -c 'cd -- /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test │ export JULIA_NUM_THREADS=1 │ export JULIA_DEPOT_PATH='\''/home/pkgeval/.julia:/usr/local/share/julia:'\'' │ export JULIA_LOAD_PATH='\''@:/tmp/jl_dA9Aps'\'' │ export JULIA_PKGEVAL=true │ export JULIA_PKG_PRECOMPILE_AUTO=0 │ export JULIA_NUM_PRECOMPILE_TASKS=1 │ export JULIA_CPU_THREADS=1 │ exec /opt/julia/bin/julia --bind-to '\''127.0.0.1:[8000]'\'' --project=/tmp/jl_dA9Aps/Project.toml -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error -E '\''using DistributedNext; DistributedNext.start_worker()'\'''"`: no such file or directory (ENOENT) │ Stacktrace: │ [1] _spawn_primitive(file::String, cmd::Cmd, stdio::Memory{Union{RawFD, Base.SyncCloseFD, IO}}) │ @ Base ./process.jl:139 │ [2] _spawn │ @ ./process.jl:156 [inlined] │ [3] #_spawn##0 │ @ ./process.jl:148 [inlined] │ [4] setup_stdios(f::Base.var"#_spawn##0#_spawn##1"{Cmd}, stdios::Vector{Union{RawFD, Base.FileRedirect, IO}}) │ @ Base ./process.jl:235 │ [5] _spawn │ @ ./process.jl:147 [inlined] │ [6] open(cmds::Cmd, stdio::Base.DevNull; write::Bool, read::Bool) │ @ Base ./process.jl:401 │ [7] open │ @ ./process.jl:396 [inlined] │ [8] open │ @ ./process.jl:375 [inlined] │ [9] open │ @ ./process.jl:374 [inlined] │ [10] launch_on_machine(manager::DistributedNext.SSHManager, machine::String, cnt::Int64, params::Dict{Symbol, Any}, launched::Vector{WorkerConfig}, launch_ntfy::Condition) │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:379 │ [11] (::DistributedNext.var"#launch##0#launch##1"{DistributedNext.SSHManager, Dict{Symbol, Any}, Vector{WorkerConfig}, Condition, String, String, Int64})() │ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:195 └ @ DistributedNext ~/.julia/packages/DistributedNext/3cHVQ/src/managers.jl:197 SSHManager: Error During Test at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:28 Got exception outside of a @test TaskFailedException Stacktrace: [1] #wait#601 @ ./task.jl:363 [inlined] [2] wait @ ./task.jl:360 [inlined] [3] DemoServer(f::var"#14#15"{UInt16}, args::Int64; timeout::Int64, kill_timeout::Int64, kwargs::@Kwargs{auth_methods::Vector{LibSSH.AuthMethod}, allow_auth_none::Bool, verbose::Bool}) @ LibSSH.Demo ~/.julia/packages/LibSSH/a57Hc/src/server.jl:899 [4] top-level scope @ ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:29 [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1777 [inlined] [6] macro expansion @ ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:32 [inlined] [7] include(mod::Module, _path::String) @ Base ./Base.jl:306 [8] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [9] _start() @ Base ./client.jl:550 nested task error: ArgumentError: Collection is empty, must contain exactly 1 element Stacktrace: [1] _only @ ./iterators.jl:1552 [inlined] [2] only(x::Vector{Int64}) @ Base.Iterators ./iterators.jl:1547 [3] (::var"#14#15"{UInt16})() @ Main ~/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:66 [4] (::LibSSH.Demo.var"#11#12"{var"#14#15"{UInt16}, Vector{Test.AbstractTestSet}, Timer})() @ LibSSH.Demo ~/.julia/packages/LibSSH/a57Hc/src/server.jl:868 Test Summary: | Fail Error Total Time SSHManager | 3 1 4 31.5s RNG of the outermost testset: Random.Xoshiro(0x4c26f9e52efa3981, 0xb94c3577adfdaa72, 0x42a72fa8b316efe2, 0x0e06f3d6a2899fd0, 0x278033762a2946f1) ERROR: LoadError: Some tests did not pass: 0 passed, 3 failed, 1 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl:28 ERROR: LoadError: failed process: Process(setenv(`/opt/julia/bin/julia -C native -J/opt/julia/lib/julia/sys.so --pkgimages=existing -g1 --startup-file=no --check-bounds=yes --startup-file=no --depwarn=error /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/sshmanager.jl`,["LANG=C.UTF-8", "PYTHON=", "PATH=/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/bin:/sbin:/opt/julia/bin", "OPENBLAS_MAIN_FREE=1", "JULIA_CPU_THREADS=1", "JULIA_NUM_PRECOMPILE_TASKS=1", "DISPLAY=:1", "JULIA_LOAD_PATH=@:/tmp/jl_dA9Aps", "PKGEVAL=true", "OPENBLAS_NUM_THREADS=1", "HOME=/home/pkgeval", "CI=true", "JULIA_PKG_PRECOMPILE_AUTO=0", "JULIA_PKGEVAL=true", "JULIA_DEPOT_PATH=/home/pkgeval/.julia:/usr/local/share/julia:", "R_HOME=*", "JULIA_NUM_THREADS=1"]), ProcessExited(1)) [1] Stacktrace: [1] pipeline_error @ ./process.jl:597 [inlined] [2] run(::Cmd; wait::Bool) @ Base ./process.jl:512 [3] run(::Cmd) @ Base ./process.jl:509 [4] top-level scope @ ~/.julia/packages/DistributedNext/3cHVQ/test/runtests.jl:26 [5] include(mapexpr::Function, mod::Module, _path::String) @ Base ./Base.jl:307 [6] top-level scope @ none:6 [7] eval(m::Module, e::Any) @ Core ./boot.jl:489 [8] exec_options(opts::Base.JLOptions) @ Base ./client.jl:283 [9] _start() @ Base ./client.jl:550 in expression starting at /home/pkgeval/.julia/packages/DistributedNext/3cHVQ/test/runtests.jl:15 Testing failed after 67.02s ERROR: LoadError: Package DistributedNext errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2538 [3] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2387 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:552 [5] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 [6] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [7] test @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] [8] #test#81 @ /opt/julia/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] [9] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:223 [10] include(mod::Module, _path::String) @ Base ./Base.jl:306 [11] exec_options(opts::Base.JLOptions) @ Base ./client.jl:317 [12] _start() @ Base ./client.jl:550 in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 PkgEval failed after 164.24s: package tests unexpectedly errored