Package evaluation of Dispatcher on Julia 1.13.0-DEV.974 (7bbb213719*) started at 2025-08-12T14:23:17.102 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Set-up completed after 8.57s ################################################################################ # Installation # Installing Dispatcher... Resolving package versions... Updating `~/.julia/environments/v1.13/Project.toml` [a48d5fe2] + Dispatcher v1.0.1 Updating `~/.julia/environments/v1.13/Manifest.toml` ⌅ [ec485272] + ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] + AutoHashEquals v0.2.0 ⌅ [864edb3b] + DataStructures v0.17.20 [d2772ebe] + DeferredFutures v1.0.0 [a48d5fe2] + Dispatcher v1.0.1 [d25df0c9] + Inflate v0.1.5 [c8e1da08] + IterTools v1.10.0 [093fc24a] + LightGraphs v1.3.5 [1914dd2f] + MacroTools v0.5.16 [f28f55f0] + Memento v1.4.1 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.2 [21216c6a] + Preferences v1.5.0 [ae029012] + Requires v1.3.1 ⌅ [08a2b407] + ResultTypes v3.2.1 [699a6c99] + SimpleTraits v0.9.5 [90137ffa] + StaticArrays v1.9.14 [1e83bf80] + StaticArraysCore v1.4.3 [10745b16] + Statistics v1.11.1 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.13.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [4536629a] + OpenBLAS_jll v0.3.29+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [8e850b90] + libblastrampoline_jll v5.13.1+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 1.19s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompilation completed after 28.57s ################################################################################ # Testing # Testing Dispatcher Status `/tmp/jl_lIPmAt/Project.toml` ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [f28f55f0] Memento v1.4.1 ⌅ [08a2b407] ResultTypes v3.2.1 [8ba89e20] Distributed v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_lIPmAt/Manifest.toml` ⌅ [ec485272] ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [d25df0c9] Inflate v0.1.5 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [1914dd2f] MacroTools v0.5.16 [f28f55f0] Memento v1.4.1 [bac558e1] OrderedCollections v1.8.1 [aea7be01] PrecompileTools v1.3.2 [21216c6a] Preferences v1.5.0 [ae029012] Requires v1.3.1 ⌅ [08a2b407] ResultTypes v3.2.1 [699a6c99] SimpleTraits v0.9.5 [90137ffa] StaticArrays v1.9.14 [1e83bf80] StaticArraysCore v1.4.3 [10745b16] Statistics v1.11.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.13.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [4536629a] OpenBLAS_jll v0.3.29+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [8e850b90] libblastrampoline_jll v5.13.1+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Precompiling packages... 1647.9 ms ? Memento Info Given Dispatcher was explicitly requested, output will be shown live  WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. 4796.3 ms ? Dispatcher WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. Precompiling packages... Info Given Memento was explicitly requested, output will be shown live  WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. 1829.3 ms ? Memento WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. Test Summary: | Pass Total Time Graph | 34 34 5.4s WARNING: Method definition foo(OtherModule.MyType) in module Main at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:367 overwritten at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:401. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op): complete. [info | Dispatcher]: Node 4 (Op, Op>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Main]: Partial array [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 4 graph nodes. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): running. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): complete. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): complete. [info | Dispatcher]: All 4 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 2: Precompiling packages... From worker 2: 1841.5 ms ? Memento From worker 2: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 2: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 2: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 2: 6624.3 ms ? Dispatcher From worker 2: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 2: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 2: Precompiling packages... From worker 2: Info Given Memento was explicitly requested, output will be shown live  From worker 2: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 2: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 2: 1745.9 ms ? Memento From worker 2: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 2: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 3: Precompiling packages... From worker 4: Precompiling packages... From worker 4: Memento Being precompiled by another process (pid: 99, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 3: 2072.7 ms ? Memento From worker 4: 5217.6 ms ✓ Memento From worker 4: Dispatcher Being precompiled by another process (pid: 99, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 3: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 3: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 3: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 3: 5799.1 ms ? Dispatcher From worker 4: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 4: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 4: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 4: 7971.4 ms ✓ Dispatcher From worker 4: 2 dependencies successfully precompiled in 14 seconds. 37 already precompiled. From worker 4: 2 dependencies had output during precompilation: From worker 4: ┌ Dispatcher From worker 4: │ [Output was shown above] From worker 4: └ From worker 4: ┌ Memento From worker 4: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 4: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 4: └ From worker 3: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 3: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 3: Precompiling packages... From worker 3: Info Given Memento was explicitly requested, output will be shown live  From worker 3: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 3: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 3: 3154.2 ms ? Memento From worker 4: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 4: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 4: Precompiling packages... From worker 4: Memento Being precompiled by another process (pid: 99, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 3: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 3: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 4: Info Given Memento was explicitly requested, output will be shown live  From worker 4: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 4: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 4: 3460.7 ms ✓ Memento From worker 4: 1 dependency successfully precompiled in 4 seconds. 14 already precompiled. From worker 4: 1 dependency had output during precompilation: From worker 4: ┌ Memento From worker 4: │ [Output was shown above] From worker 4: └ From worker 4: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 4: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Async - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException TaskFailedException nested task error: MethodError: no method matching /(::DependencyError{TaskFailedException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::Missing, ::Number) @ Base missing.jl:125 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:565 /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:640 ... Stacktrace: [1] (::var"#112#113"{Channel{Float64}})(x::DependencyError{TaskFailedException}) @ Main ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:661 [2] run!(op::Op) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:343 [3] (::Dispatcher.var"#dispatch!##0#dispatch!##1"{Op})() @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:421 Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{TaskFailedException}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/pmap.jl:167 [3] (::Base.var"#952#953"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}})(r::Base.RefValue{Any}, args::Tuple{Int64}) @ Base ./asyncmap.jl:96 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#952#953"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}}, Channel{Any}, Nothing})() @ Base ./asyncmap.jl:230 Stacktrace: [1] (::Base.var"#maptwice##0#maptwice##1")(x::Task) @ Base ./asyncmap.jl:173 [2] foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) @ Base ./abstractarray.jl:3202 [3] maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::UnitRange{Int64}) @ Base ./asyncmap.jl:173 [4] wrap_n_exec_twice @ ./asyncmap.jl:149 [inlined] [5] async_usemap(f::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base ./asyncmap.jl:99 [6] async_usemap @ ./asyncmap.jl:80 [inlined] [7] #asyncmap#937 @ ./asyncmap.jl:77 [inlined] [8] asyncmap @ ./asyncmap.jl:76 [inlined] [9] dispatch!(exec::AsyncExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [10] dispatch! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:244 [inlined] [11] run!(exec::AsyncExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [12] run! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [13] run!(exec::AsyncExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [14] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [15] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [16] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [18] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [20] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [22] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:857 [inlined] [24] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] Stacktrace: [1] do_test_throws(result::Test.ExecutionResult, orig_expr::Any, extype::Any) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:902 [2] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [4] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [6] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [8] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [10] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. From worker 5: Precompiling packages... From worker 5: 1937.2 ms ? Memento From worker 5: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 5: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 5: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 5: 5624.1 ms ? Dispatcher From worker 5: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 5: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 5: Precompiling packages... From worker 5: Info Given Memento was explicitly requested, output will be shown live  From worker 5: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 5: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 5: 2118.7 ms ? Memento From worker 5: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 5: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Parallel - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException MethodError: no method matching /(::DependencyError{RemoteException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::Missing, ::Number) @ Base missing.jl:125 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:565 /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:640 ... Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{MethodError}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/pmap.jl:167 [3] (::Base.var"#952#953"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}})(r::Base.RefValue{Any}, args::Tuple{Int64}) @ Base ./asyncmap.jl:96 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#952#953"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}}, Channel{Any}, Nothing})() @ Base ./asyncmap.jl:230 Stacktrace: [1] (::Base.var"#maptwice##0#maptwice##1")(x::Task) @ Base ./asyncmap.jl:173 [2] foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) @ Base ./abstractarray.jl:3202 [3] maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::UnitRange{Int64}) @ Base ./asyncmap.jl:173 [4] wrap_n_exec_twice @ ./asyncmap.jl:149 [inlined] [5] async_usemap(f::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base ./asyncmap.jl:99 [6] async_usemap @ ./asyncmap.jl:80 [inlined] [7] #asyncmap#937 @ ./asyncmap.jl:77 [inlined] [8] asyncmap @ ./asyncmap.jl:76 [inlined] [9] dispatch!(exec::ParallelExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [10] dispatch! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:244 [inlined] [11] run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [12] run! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [13] run!(exec::ParallelExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [14] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [15] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [16] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [18] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [20] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [22] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:857 [inlined] [24] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] Stacktrace: [1] do_test_throws(result::Test.ExecutionResult, orig_expr::Any, extype::Any) @ Test /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:902 [2] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [3] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [4] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [5] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [6] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [7] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [8] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [9] macro expansion @ /opt/julia/share/julia/stdlib/v1.13/Test/src/Test.jl:1929 [inlined] [10] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. From worker 6: Precompiling packages... From worker 7: Precompiling packages... From worker 7: Memento Being precompiled by another process (pid: 195, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 6: 2595.1 ms ? Memento From worker 7: 6619.8 ms ✓ Memento From worker 7: Dispatcher Being precompiled by another process (pid: 195, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 6: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 6: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 6: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 6: 8406.1 ms ? Dispatcher From worker 7: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 7: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 7: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 7: 10432.0 ms ✓ Dispatcher From worker 7: 2 dependencies successfully precompiled in 19 seconds. 37 already precompiled. From worker 7: 2 dependencies had output during precompilation: From worker 7: ┌ Dispatcher From worker 7: │ [Output was shown above] From worker 7: └ From worker 7: ┌ Memento From worker 7: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 7: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 7: └ From worker 6: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 6: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 6: Precompiling packages... From worker 6: Info Given Memento was explicitly requested, output will be shown live  From worker 6: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 6: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 6: 4035.5 ms ? Memento From worker 7: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 7: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 7: Precompiling packages... From worker 7: Memento Being precompiled by another process (pid: 195, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 6: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 6: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 7: Info Given Memento was explicitly requested, output will be shown live  From worker 7: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 7: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 7: 5185.0 ms ✓ Memento From worker 7: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 7: 1 dependency had output during precompilation: From worker 7: ┌ Memento From worker 7: │ [Output was shown above] From worker 7: └ From worker 7: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 7: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 6: From worker 6: ====================================================================================== From worker 6: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 6: ====================================================================================== From worker 6: From worker 6: cmd: /opt/julia/bin/julia 195 running 1 of 1 From worker 6: From worker 6: signal (10): User defined signal 1 From worker 6: _ZN4llvm8Constant15getAllOnesValueEPNS_4TypeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZL24getMaskedTypeForICmpPairRPN4llvm5ValueES2_S2_S2_S2_S1_S1_RNS_7CmpInst9PredicateES5_.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZN4llvm16InstCombinerImpl16foldAndOrOfICmpsEPNS_8ICmpInstES2_RNS_11InstructionEbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZN4llvm16InstCombinerImpl16foldBooleanAndOrEPNS_5ValueES2_RNS_11InstructionEbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZN4llvm16InstCombinerImpl8visitAndERNS_14BinaryOperatorE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZN4llvm16InstCombinerImpl3runEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZL31combineInstructionsOverFunctionRN4llvm8FunctionERNS_19InstructionWorklistEPNS_9AAResultsERNS_15AssumptionCacheERNS_17TargetLibraryInfoERNS_19TargetTransformInfoERNS_13DominatorTreeERNS_25OptimizationRemarkEmitterEPNS_18BlockFrequencyInfoEPNS_21BranchProbabilityInfoEPNS_18ProfileSummaryInfoERKNS_18InstCombineOptionsE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: _ZN4llvm15InstCombinePass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 6: _ZN4llvm11PassManagerINS_8FunctionENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 6: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 6: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 6: run at /source/src/pipeline.cpp:791 From worker 6: operator() at /source/src/jitlayers.cpp:1510 From worker 6: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 6: operator() at /source/src/jitlayers.cpp:1471 [inlined] From worker 6: operator() at /source/src/jitlayers.cpp:1623 [inlined] From worker 6: addModule at /source/src/jitlayers.cpp:2080 From worker 6: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 6: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 6: jl_compile_method_internal at /source/src/gf.c:3527 From worker 6: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4212 From worker 6: serialize_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:78 From worker 6: unknown function (ip: 0x784394b92846) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4212 From worker 6: jl_apply at /source/src/julia.h:2375 [inlined] From worker 6: jl_f_invokelatest at /source/src/builtins.c:877 From worker 6: send_msg_ at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:181 From worker 6: send_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:122 [inlined] From worker 6: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:460 From worker 6: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 6: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 6: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 6: call_on_owner at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:565 [inlined] From worker 6: fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:656 From worker 6: unknown function (ip: 0x784394b91dd2) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4212 From worker 6: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 6: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 6: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 6: #952 at ./asyncmap.jl:96 From worker 6: unknown function (ip: 0x784394b91406) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4212 From worker 6: jl_apply at /source/src/julia.h:2375 [inlined] From worker 6: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 6: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 6: unknown function (ip: 0x784394b8ad3f) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4212 From worker 6: jl_apply at /source/src/julia.h:2375 [inlined] From worker 6: start_task at /source/src/task.c:1253 From worker 6: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. ┌ Warning: Sending SIGQUIT to worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 9: Precompiling packages... From worker 8: Precompiling packages... From worker 8: Memento Being precompiled by another process (pid: 0, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 9: 2290.6 ms ? Memento From worker 8: 6217.0 ms ✓ Memento From worker 8: Dispatcher Being precompiled by another process (pid: 261, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 9: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 9: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 9: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 9: 7902.9 ms ? Dispatcher From worker 8: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 8: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 8: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 8: 10326.6 ms ✓ Dispatcher From worker 8: 2 dependencies successfully precompiled in 18 seconds. 37 already precompiled. From worker 8: 2 dependencies had output during precompilation: From worker 8: ┌ Dispatcher From worker 8: │ [Output was shown above] From worker 8: └ From worker 8: ┌ Memento From worker 8: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 8: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 8: └ From worker 8: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 8: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 8: Precompiling packages... From worker 8: Info Given Memento was explicitly requested, output will be shown live  From worker 8: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 8: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 8: 4320.1 ms ? Memento From worker 9: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 9: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 9: Precompiling packages... From worker 9: Memento Being precompiled by another process (pid: 259, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 8: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 8: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 9: Info Given Memento was explicitly requested, output will be shown live  From worker 9: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 9: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 9: 5900.5 ms ✓ Memento From worker 9: 1 dependency successfully precompiled in 6 seconds. 14 already precompiled. From worker 9: 1 dependency had output during precompilation: From worker 9: ┌ Memento From worker 9: │ [Output was shown above] From worker 9: └ From worker 9: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 9: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 8: From worker 8: ====================================================================================== From worker 8: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 8: ====================================================================================== From worker 8: From worker 8: cmd: /opt/julia/bin/julia 259 running 1 of 1 From worker 8: From worker 8: signal (10): User defined signal 1 From worker 8: _ZNK4llvm12MachineInstr30isDereferenceableInvariantLoadEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZNK4llvm12MachineInstr12isSafeToMoveERb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN12_GLOBAL__N_114MachineSinking15SinkInstructionERN4llvm12MachineInstrERbRNS1_13SmallDenseMapIPNS1_17MachineBasicBlockENS1_11SmallVectorIS7_Lj4EEELj4ENS1_12DenseMapInfoIS7_vEENS1_6detail12DenseMapPairIS7_S9_EEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN12_GLOBAL__N_114MachineSinking20runOnMachineFunctionERN4llvm15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 8: operator() at /source/src/jitlayers.cpp:1612 From worker 8: addModule at /source/src/jitlayers.cpp:2093 From worker 8: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 8: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 8: jl_compile_method_internal at /source/src/gf.c:3527 From worker 8: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: map at ./abstractarray.jl:3416 From worker 8: maptwice at ./asyncmap.jl:157 From worker 8: wrap_n_exec_twice at ./asyncmap.jl:149 [inlined] From worker 8: #async_usemap#938 at ./asyncmap.jl:99 [inlined] From worker 8: async_usemap at ./asyncmap.jl:80 [inlined] From worker 8: #asyncmap#937 at ./asyncmap.jl:77 [inlined] From worker 8: asyncmap at ./asyncmap.jl:76 From worker 8: unknown function (ip: 0x73a5faf91c86) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 8: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/macros.jl:43 From worker 8: unknown function (ip: 0x73a5faf9088f) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: jl_apply at /source/src/julia.h:2375 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:877 From worker 8: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: jl_apply at /source/src/julia.h:2375 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 8: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:283 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 8: unknown function (ip: 0x73a5faf88e0b) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:79 From worker 8: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:88 From worker 8: unknown function (ip: 0x73a5faf889af) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4212 From worker 8: jl_apply at /source/src/julia.h:2375 [inlined] From worker 8: start_task at /source/src/task.c:1253 From worker 8: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Warning: Sending SIGQUIT to worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 10: Precompiling packages... From worker 11: Precompiling packages... From worker 11: Memento Being precompiled by another process (pid: 323, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 10: 2333.5 ms ? Memento From worker 11: 6443.4 ms ✓ Memento From worker 11: Dispatcher Being precompiled by another process (pid: 323, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 10: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 10: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 10: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 10: 8686.2 ms ? Dispatcher From worker 11: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 11: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 11: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 11: 10450.5 ms ✓ Dispatcher From worker 11: 2 dependencies successfully precompiled in 18 seconds. 37 already precompiled. From worker 11: 2 dependencies had output during precompilation: From worker 11: ┌ Dispatcher From worker 11: │ [Output was shown above] From worker 11: └ From worker 11: ┌ Memento From worker 11: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 11: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 11: └ From worker 10: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 10: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 10: Precompiling packages... From worker 10: Info Given Memento was explicitly requested, output will be shown live  From worker 10: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 10: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 10: 4073.6 ms ? Memento From worker 11: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 11: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 11: Precompiling packages... From worker 11: Memento Being precompiled by another process (pid: 323, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 10: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 10: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 11: Info Given Memento was explicitly requested, output will be shown live  From worker 11: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 11: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 11: 4844.6 ms ✓ Memento From worker 11: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 11: 1 dependency had output during precompilation: From worker 11: ┌ Memento From worker 11: │ [Output was shown above] From worker 11: └ From worker 11: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 11: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 10: From worker 10: ====================================================================================== From worker 10: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 10: ====================================================================================== From worker 10: From worker 10: cmd: /opt/julia/bin/julia 323 running 1 of 1 From worker 10: From worker 10: signal (10): User defined signal 1 From worker 10: _ZN4llvm4Pass13releaseMemoryEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 10: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Warning: Sending SIGQUIT to worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 13: Precompiling packages... From worker 12: Precompiling packages... From worker 12: Memento Being precompiled by another process (pid: 388, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 13: 2442.1 ms ? Memento From worker 12: 6875.9 ms ✓ Memento From worker 12: Dispatcher Being precompiled by another process (pid: 388, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 13: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 13: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 13: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 13: 8434.3 ms ? Dispatcher From worker 12: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 12: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 12: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 12: 10274.9 ms ✓ Dispatcher From worker 12: 2 dependencies successfully precompiled in 18 seconds. 37 already precompiled. From worker 12: 2 dependencies had output during precompilation: From worker 12: ┌ Dispatcher From worker 12: │ [Output was shown above] From worker 12: └ From worker 12: ┌ Memento From worker 12: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 12: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 12: └ From worker 13: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 13: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 13: Precompiling packages... From worker 13: Info Given Memento was explicitly requested, output will be shown live  From worker 13: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 13: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 13: 4251.9 ms ? Memento From worker 12: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 12: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 12: Precompiling packages... From worker 12: Memento Being precompiled by another process (pid: 388, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 13: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 13: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 12: Info Given Memento was explicitly requested, output will be shown live  From worker 12: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 12: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 12: 4652.8 ms ✓ Memento From worker 12: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 12: 1 dependency had output during precompilation: From worker 12: ┌ Memento From worker 12: │ [Output was shown above] From worker 12: └ From worker 12: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 12: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 12: From worker 12: ====================================================================================== From worker 12: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 12: ====================================================================================== From worker 12: From worker 12: cmd: /opt/julia/bin/julia 387 running 1 of 1 From worker 12: From worker 12: signal (10): User defined signal 1 From worker 12: _ZNK4llvm5APInt8uadd_satERKS0_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm21computeExpressionSizeENS_8ArrayRefIPKNS_4SCEVEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution21getOrCreateAddRecExprENS_8ArrayRefIPKNS_4SCEVEEEPKNS_4LoopENS2_11NoWrapFlagsE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution10getMulExprERNS_15SmallVectorImplIPKNS_4SCEVEEENS2_11NoWrapFlagsEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution10getMulExprEPKNS_4SCEVES3_NS1_11NoWrapFlagsEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution14createSCEVIterEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution24computeExitLimitFromICmpEPKNS_4LoopEPNS_8ICmpInstEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution28computeExitLimitFromCondImplERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution30computeExitLimitFromCondCachedERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution33computeExitLimitFromCondFromBinOpERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution28computeExitLimitFromCondImplERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution30computeExitLimitFromCondCachedERNS0_14ExitLimitCacheEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution24computeExitLimitFromCondEPKNS_4LoopEPNS_5ValueEbbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution16computeExitLimitEPKNS_4LoopEPNS_10BasicBlockEbb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution25computeBackedgeTakenCountEPKNS_4LoopEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution20getBackedgeTakenInfoEPKNS_4LoopE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution28proveNoWrapViaConstantRangesEPKNS_14SCEVAddRecExprE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution24createSimpleAffineAddRecEPNS_7PHINodeEPNS_5ValueES4_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution19createAddRecFromPHIEPNS_7PHINodeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution16createNodeForPHIEPNS_7PHINodeE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm15ScalarEvolution14createSCEVIterEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN12_GLOBAL__N_119InductiveRangeCheck26extractRangeChecksFromCondEPN4llvm4LoopERNS1_15ScalarEvolutionERNS1_3UseERNS1_15SmallVectorImplIS0_EERNS1_15SmallPtrSetImplIPNS1_5ValueEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN12_GLOBAL__N_130InductiveRangeCheckElimination3runEPN4llvm4LoopENS1_12function_refIFvS3_bEEE.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: _ZN4llvm8IRCEPass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 12: _ZN4llvm11PassManagerINS_8FunctionENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 12: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 12: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 12: run at /source/src/pipeline.cpp:791 From worker 12: operator() at /source/src/jitlayers.cpp:1510 From worker 12: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 12: operator() at /source/src/jitlayers.cpp:1471 [inlined] From worker 12: operator() at /source/src/jitlayers.cpp:1623 [inlined] From worker 12: addModule at /source/src/jitlayers.cpp:2080 From worker 12: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 12: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 12: jl_compile_method_internal at /source/src/gf.c:3527 From worker 12: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4212 From worker 12: _atexit at ./initdefs.jl:464 From worker 12: jfptr__atexit_32884.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 12: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4212 From worker 12: jl_apply at /source/src/julia.h:2375 [inlined] From worker 12: ijl_atexit_hook at /source/src/init.c:260 From worker 12: ijl_exit at /source/src/init.c:196 From worker 12: jlplt_ijl_exit_44908.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 12: exit at ./initdefs.jl:28 From worker 12: exit at ./initdefs.jl:29 From worker 12: jfptr_exit_60072.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 12: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4212 From worker 12: jl_apply at /source/src/julia.h:2375 [inlined] From worker 12: jl_f_invokelatest at /source/src/builtins.c:877 From worker 12: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4212 From worker 12: jl_apply at /source/src/julia.h:2375 [inlined] From worker 12: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 12: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 12: run_work_thunk at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 12: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 12: unknown function (ip: 0x75235fd392bf) at (unknown file) From worker 12: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4212 From worker 12: jl_apply at /source/src/julia.h:2375 [inlined] From worker 12: start_task at /source/src/task.c:1253 From worker 12: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. ┌ Warning: Sending SIGQUIT to worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 14: Precompiling packages... From worker 15: Precompiling packages... From worker 15: Memento Being precompiled by another process (pid: 451, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 14: 1988.7 ms ? Memento From worker 15: 5457.8 ms ✓ Memento From worker 15: Dispatcher Being precompiled by another process (pid: 451, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 14: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 14: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 14: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 14: 6611.4 ms ? Dispatcher From worker 15: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 15: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 15: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 15: 7840.8 ms ✓ Dispatcher From worker 15: 2 dependencies successfully precompiled in 14 seconds. 37 already precompiled. From worker 15: 2 dependencies had output during precompilation: From worker 15: ┌ Dispatcher From worker 15: │ [Output was shown above] From worker 15: └ From worker 15: ┌ Memento From worker 15: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 15: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 15: └ From worker 15: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 15: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 15: Precompiling packages... From worker 15: Info Given Memento was explicitly requested, output will be shown live  From worker 15: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 15: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 15: 3603.4 ms ? Memento From worker 14: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 14: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 14: Precompiling packages... From worker 14: Memento Being precompiled by another process (pid: 452, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 15: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 15: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 14: Info Given Memento was explicitly requested, output will be shown live  From worker 14: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 14: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 14: 4789.0 ms ✓ Memento From worker 14: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 14: 1 dependency had output during precompilation: From worker 14: ┌ Memento From worker 14: │ [Output was shown above] From worker 14: └ From worker 14: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 14: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 14: From worker 14: ====================================================================================== From worker 14: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 14: ====================================================================================== From worker 14: From worker 14: cmd: /opt/julia/bin/julia 451 running 1 of 1 From worker 14: From worker 14: signal (10): User defined signal 1 From worker 14: _ZNK4llvm14MCRegisterInfo15isSuperRegisterENS_10MCRegisterES1_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm12MachineInstr17addRegisterKilledENS_8RegisterEPKNS_18TargetRegisterInfoEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13LiveVariables17HandlePhysRegKillENS_8RegisterEPNS_12MachineInstrE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13LiveVariables16HandlePhysRegDefENS_8RegisterEPNS_12MachineInstrERNS_15SmallVectorImplIS1_EE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13LiveVariables10runOnBlockEPNS_17MachineBasicBlockEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13LiveVariables7analyzeERNS_15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm24LiveVariablesWrapperPass20runOnMachineFunctionERNS_15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 14: operator() at /source/src/jitlayers.cpp:1612 From worker 14: addModule at /source/src/jitlayers.cpp:2093 From worker 14: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 14: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 14: jl_compile_method_internal at /source/src/gf.c:3527 From worker 14: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4212 From worker 14: serialize_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:78 From worker 14: unknown function (ip: 0x7d65583bfdd6) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4212 From worker 14: jl_apply at /source/src/julia.h:2375 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:877 From worker 14: send_msg_ at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:181 From worker 14: send_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:122 [inlined] From worker 14: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:460 From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 14: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 14: call_on_owner at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:565 [inlined] From worker 14: fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:656 From worker 14: unknown function (ip: 0x7d65583bf6a2) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4212 From worker 14: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 14: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 14: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 14: #952 at ./asyncmap.jl:96 From worker 14: unknown function (ip: 0x7d65583bef96) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4212 From worker 14: jl_apply at /source/src/julia.h:2375 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 14: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 14: unknown function (ip: 0x7d65583b7cff) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4212 From worker 14: jl_apply at /source/src/julia.h:2375 [inlined] From worker 14: start_task at /source/src/task.c:1253 From worker 14: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Warning: Sending SIGQUIT to worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 16: Precompiling packages... From worker 17: Precompiling packages... From worker 17: Memento Being precompiled by another process (pid: 515, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 16: 2167.8 ms ? Memento From worker 17: 5375.1 ms ✓ Memento From worker 17: Dispatcher Being precompiled by another process (pid: 515, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 16: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 16: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 16: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 16: 7237.6 ms ? Dispatcher From worker 17: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 17: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 17: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 17: 10687.0 ms ✓ Dispatcher From worker 17: 2 dependencies successfully precompiled in 18 seconds. 37 already precompiled. From worker 17: 2 dependencies had output during precompilation: From worker 17: ┌ Dispatcher From worker 17: │ [Output was shown above] From worker 17: └ From worker 17: ┌ Memento From worker 17: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 17: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 17: └ From worker 16: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 16: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 16: Precompiling packages... From worker 16: Info Given Memento was explicitly requested, output will be shown live  From worker 16: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 16: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 16: 3038.5 ms ? Memento From worker 17: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 17: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 17: Precompiling packages... From worker 17: Memento Being precompiled by another process (pid: 515, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 16: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 16: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 17: Info Given Memento was explicitly requested, output will be shown live  From worker 17: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 17: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 17: 3962.5 ms ✓ Memento From worker 17: 1 dependency successfully precompiled in 4 seconds. 14 already precompiled. From worker 17: 1 dependency had output during precompilation: From worker 17: ┌ Memento From worker 17: │ [Output was shown above] From worker 17: └ From worker 17: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 17: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. From worker 19: Precompiling packages... From worker 18: Precompiling packages... From worker 18: Memento Being precompiled by another process (pid: 0, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 19: 1604.4 ms ? Memento From worker 18: 5066.0 ms ✓ Memento From worker 18: Dispatcher Being precompiled by another process (pid: 580, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 19: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 19: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 19: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 19: 6935.9 ms ? Dispatcher From worker 18: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 18: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 18: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 18: 9349.6 ms ✓ Dispatcher From worker 18: 2 dependencies successfully precompiled in 15 seconds. 37 already precompiled. From worker 18: 2 dependencies had output during precompilation: From worker 18: ┌ Dispatcher From worker 18: │ [Output was shown above] From worker 18: └ From worker 18: ┌ Memento From worker 18: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 18: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 18: └ From worker 19: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 19: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 19: Precompiling packages... From worker 19: Info Given Memento was explicitly requested, output will be shown live  From worker 19: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 19: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 19: 2914.7 ms ? Memento From worker 18: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 18: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 18: Precompiling packages... From worker 18: Memento Being precompiled by another process (pid: 580, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 19: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 19: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 18: Info Given Memento was explicitly requested, output will be shown live  From worker 18: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 18: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 18: 3562.6 ms ✓ Memento From worker 18: 1 dependency successfully precompiled in 4 seconds. 14 already precompiled. From worker 18: 1 dependency had output during precompilation: From worker 18: ┌ Memento From worker 18: │ [Output was shown above] From worker 18: └ From worker 18: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 18: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 18: From worker 18: ====================================================================================== From worker 18: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 18: ====================================================================================== From worker 19: From worker 19: ====================================================================================== From worker 19: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 19: ====================================================================================== From worker 19: From worker 19: cmd: /opt/julia/bin/julia 580 running 1 of 1 From worker 19: From worker 19: signal (10): User defined signal 1 From worker 19: _ZN4llvm7hashing6detail23hash_combine_range_implIKjEENSt9enable_ifIXsrNS1_16is_hashable_dataIT_EE5valueENS_9hash_codeEE4typeEPS6_SB_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm14FoldingSetBase19FindNodeOrInsertPosERKNS_16FoldingSetNodeIDERPvRKNS0_14FoldingSetInfoE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: From worker 18: cmd: /opt/julia/bin/julia 579 running 1 of 1 From worker 18: From worker 18: signal (10): User defined signal 1 From worker 19: _ZN4llvm17PMTopLevelManager17findAnalysisUsageEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm17PMTopLevelManager12schedulePassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm16TargetPassConfig7addPassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm16TargetPassConfig16addMachinePassesEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZL23addPassesToGenerateCodeRN4llvm24CodeGenTargetMachineImplERNS_6legacy15PassManagerBaseEbRNS_28MachineModuleInfoWrapperPassE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm15SmallVectorImplINS_4SDepEEaSEOS2_.isra.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm24CodeGenTargetMachineImpl17addPassesToEmitMCERNS_6legacy15PassManagerBaseERPNS_9MCContextERNS_17raw_pwrite_streamEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm11ScheduleDAG8clearDAGEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm17ScheduleDAGInstrs15buildSchedGraphEPNS_9AAResultsEPNS_18RegPressureTrackerEPNS_13PressureDiffsEPNS_13LiveIntervalsEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm17ScheduleDAGMILive8scheduleEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN12_GLOBAL__N_120MachineSchedulerBase15scheduleRegionsERN4llvm17ScheduleDAGInstrsEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN12_GLOBAL__N_116MachineScheduler20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 18: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 19: operator() at /source/src/jitlayers.cpp:1612 From worker 19: addModule at /source/src/jitlayers.cpp:2093 From worker 19: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 19: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 18: operator() at /source/src/jitlayers.cpp:1612 From worker 18: addModule at /source/src/jitlayers.cpp:2093 From worker 19: jl_compile_method_internal at /source/src/gf.c:3527 From worker 19: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 19: ijl_apply_generic at /source/src/gf.c:4212 From worker 19: summary at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:229 From worker 19: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:323 From worker 19: #952 at ./asyncmap.jl:96 From worker 19: unknown function (ip: 0x7bba60534ce6) at (unknown file) From worker 19: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 19: ijl_apply_generic at /source/src/gf.c:4212 From worker 18: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 18: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 19: jl_apply at /source/src/julia.h:2375 [inlined] From worker 19: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 19: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 19: unknown function (ip: 0x7bba6052c05f) at (unknown file) From worker 19: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 19: ijl_apply_generic at /source/src/gf.c:4212 From worker 18: jl_compile_method_internal at /source/src/gf.c:3527 From worker 18: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4212 From worker 18: jl_apply at /source/src/julia.h:2375 [inlined][info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. From worker 18: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 18: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 18: unknown function (ip: 0x7a5c5298dfff) at (unknown file) [info | Dispatcher]: Node 4 (Op, Op<4>>): running. From worker 18: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4212 From worker 18: jl_apply at /source/src/julia.h:2375 [inlined] From worker 18: start_task at /source/src/task.c:1253 From worker 18: unknown function (ip: (nil)) at (unknown file) From worker 19: jl_apply at /source/src/julia.h:2375 [inlined] From worker 19: start_task at /source/src/task.c:1253 From worker 19: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 20: Precompiling packages... From worker 21: Precompiling packages... From worker 21: Memento Being precompiled by another process (pid: 643, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 20: 2302.4 ms ? Memento From worker 21: 6287.7 ms ✓ Memento From worker 21: Dispatcher Being precompiled by another process (pid: 643, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 20: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 20: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 20: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 20: 7720.4 ms ? Dispatcher From worker 21: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 21: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 21: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 21: 9999.9 ms ✓ Dispatcher From worker 21: 2 dependencies successfully precompiled in 17 seconds. 37 already precompiled. From worker 21: 2 dependencies had output during precompilation: From worker 21: ┌ Dispatcher From worker 21: │ [Output was shown above] From worker 21: └ From worker 21: ┌ Memento From worker 21: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 21: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 21: └ From worker 20: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 20: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 20: Precompiling packages... From worker 20: Info Given Memento was explicitly requested, output will be shown live  From worker 20: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 20: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 20: 3108.1 ms ? Memento From worker 21: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 21: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 21: Precompiling packages... From worker 21: Memento Being precompiled by another process (pid: 643, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 20: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 20: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 21: Info Given Memento was explicitly requested, output will be shown live  From worker 21: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 21: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 21: 4586.9 ms ✓ Memento From worker 21: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 21: 1 dependency had output during precompilation: From worker 21: ┌ Memento From worker 21: │ [Output was shown above] From worker 21: └ From worker 21: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 21: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 21: From worker 21: ====================================================================================== From worker 21: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 21: ====================================================================================== From worker 20: From worker 20: ====================================================================================== From worker 20: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 20: ====================================================================================== From worker 20: From worker 20: cmd: /opt/julia/bin/julia 643 running 1 of 1 From worker 20: From worker 20: signal (10): User defined signal 1 From worker 21: From worker 21: cmd: /opt/julia/bin/julia 645 running 1 of 1 From worker 21: From worker 21: signal (10): User defined signal 1 From worker 20: _ZNK4llvm12X86InstrInfo15isCopyInstrImplERKNS_12MachineInstrE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 20: unknown function (ip: 0x75fa319fa89f) at (unknown file) From worker 20: unknown function (ip: (nil)) at (unknown file) From worker 21: _ZN4llvm13ConstantRangeD2Ev at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZNK4llvm13ConstantRange8multiplyERKS0_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm15ScalarEvolution11getRangeRefEPKNS_4SCEVENS0_13RangeSignHintEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZL21StrengthenNoWrapFlagsPN4llvm15ScalarEvolutionENS_9SCEVTypesENS_8ArrayRefIPKNS_4SCEVEEENS4_11NoWrapFlagsE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm15ScalarEvolution10getAddExprERNS_15SmallVectorImplIPKNS_4SCEVEEENS2_11NoWrapFlagsEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm15ScalarEvolution10getAddExprEPKNS_4SCEVES3_NS1_11NoWrapFlagsEj.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm15ScalarEvolution10getMulExprEPKNS_4SCEVES3_NS1_11NoWrapFlagsEj at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm15ScalarEvolution14createSCEVIterEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN12_GLOBAL__N_119InductiveRangeCheck26extractRangeChecksFromCondEPN4llvm4LoopERNS1_15ScalarEvolutionERNS1_3UseERNS1_15SmallVectorImplIS0_EERNS1_15SmallPtrSetImplIPNS1_5ValueEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN12_GLOBAL__N_130InductiveRangeCheckElimination3runEPN4llvm4LoopENS1_12function_refIFvS3_bEEE.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: _ZN4llvm8IRCEPass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 21: _ZN4llvm11PassManagerINS_8FunctionENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 21: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 21: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 21: run at /source/src/pipeline.cpp:791 From worker 21: operator() at /source/src/jitlayers.cpp:1510 From worker 21: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 21: operator() at /source/src/jitlayers.cpp:1471 [inlined] From worker 21: operator() at /source/src/jitlayers.cpp:1623 [inlined] From worker 21: addModule at /source/src/jitlayers.cpp:2080 From worker 21: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 21: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 21: jl_compile_method_internal at /source/src/gf.c:3527 From worker 21: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4212 From worker 21: _atexit at ./initdefs.jl:464 From worker 21: jfptr__atexit_32884.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 21: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4212 From worker 21: jl_apply at /source/src/julia.h:2375 [inlined] From worker 21: ijl_atexit_hook at /source/src/init.c:260 From worker 21: ijl_exit at /source/src/init.c:196 From worker 21: jlplt_ijl_exit_44908.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 21: exit at ./initdefs.jl:28 From worker 21: exit at ./initdefs.jl:29 From worker 21: jfptr_exit_60072.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 21: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4212 From worker 21: jl_apply at /source/src/julia.h:2375 [inlined] From worker 21: jl_f_invokelatest at /source/src/builtins.c:877 From worker 21: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4212 From worker 21: jl_apply at /source/src/julia.h:2375 [inlined] From worker 21: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 21: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 21: run_work_thunk at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 21: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 21: unknown function (ip: 0x7c1c25b3936f) at (unknown file) From worker 21: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4212 From worker 21: jl_apply at /source/src/julia.h:2375 [inlined] From worker 21: start_task at /source/src/task.c:1253 From worker 21: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 3 (Op>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 23: Precompiling packages... From worker 22: Precompiling packages... From worker 22: Memento Being precompiled by another process (pid: 709, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 23: 2342.8 ms ? Memento From worker 22: 6374.3 ms ✓ Memento From worker 22: Dispatcher Being precompiled by another process (pid: 709, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 23: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 23: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 23: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 23: 9237.4 ms ? Dispatcher From worker 22: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 22: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 22: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 22: 10492.9 ms ✓ Dispatcher From worker 22: 2 dependencies successfully precompiled in 18 seconds. 37 already precompiled. From worker 22: 2 dependencies had output during precompilation: From worker 22: ┌ Dispatcher From worker 22: │ [Output was shown above] From worker 22: └ From worker 22: ┌ Memento From worker 22: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 22: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 22: └ From worker 23: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 23: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 23: Precompiling packages... From worker 23: Info Given Memento was explicitly requested, output will be shown live  From worker 23: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 23: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 23: 3291.0 ms ? Memento From worker 22: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 22: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 22: Precompiling packages... From worker 22: Memento Being precompiled by another process (pid: 709, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 23: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 23: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 22: Info Given Memento was explicitly requested, output will be shown live  From worker 22: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 22: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 22: 3873.8 ms ✓ Memento From worker 22: 1 dependency successfully precompiled in 4 seconds. 14 already precompiled. From worker 22: 1 dependency had output during precompilation: From worker 22: ┌ Memento From worker 22: │ [Output was shown above] From worker 22: └ From worker 22: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 22: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 22: From worker 22: ====================================================================================== From worker 22: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 22: ====================================================================================== From worker 23: From worker 23: ====================================================================================== From worker 23: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 23: ====================================================================================== From worker 22: From worker 22: cmd: /opt/julia/bin/julia 707 running 1 of 1 From worker 22: From worker 22: signal (10): User defined signal 1 From worker 23: From worker 23: cmd: /opt/julia/bin/julia 709 running 1 of 1 From worker 23: From worker 23: signal (10): User defined signal 1 From worker 23: gc_try_claim_and_push at /source/src/gc-stock.c:1688 [inlined] From worker 23: gc_mark_objarray at /source/src/gc-stock.c:1842 From worker 23: gc_mark_outrefs at /source/src/gc-stock.c:2417 [inlined] From worker 23: gc_mark_loop_serial_ at /source/src/gc-stock.c:2524 From worker 23: gc_mark_loop_serial at /source/src/gc-stock.c:2547 From worker 23: gc_mark_loop at /source/src/gc-stock.c:2735 [inlined] From worker 23: _jl_gc_collect at /source/src/gc-stock.c:3080 From worker 23: ijl_gc_collect at /source/src/gc-stock.c:3489 From worker 23: maybe_collect at /source/src/gc-stock.c:349 [inlined] From worker 23: jl_gc_small_alloc_inner at /source/src/gc-stock.c:725 From worker 23: jl_gc_small_alloc_noinline at /source/src/gc-stock.c:783 [inlined] From worker 23: jl_gc_alloc_ at /source/src/gc-stock.c:797 From worker 23: _new_array at /source/src/array.c:64 [inlined] From worker 23: new_array at /source/src/array.c:86 [inlined] From worker 23: ijl_alloc_array_1d at /source/src/array.c:149 From worker 23: ijl_uncompress_ir at /source/src/ircode.c:1167 From worker 22: _ZN4llvm12DenseMapBaseINS_8DenseMapINS_3orc15SymbolStringPtrENS2_8JITDylib17MaterializingInfoENS_12DenseMapInfoIS3_vEENS_6detail12DenseMapPairIS3_S5_EEEES3_S5_S7_SA_E4findERKS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 22: _ZN4llvm3orc8JITDylib7resolveERNS0_29MaterializationResponsibilityERKNS_8DenseMapINS0_15SymbolStringPtrENS0_17ExecutorSymbolDefENS_12DenseMapInfoIS5_vEENS_6detail12DenseMapPairIS5_S6_EEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 22: _ZN4llvm3orc16ExecutionSession17OL_notifyResolvedERNS0_29MaterializationResponsibilityERKNS_8DenseMapINS0_15SymbolStringPtrENS0_17ExecutorSymbolDefENS_12DenseMapInfoIS5_vEENS_6detail12DenseMapPairIS5_S6_EEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 22: _ZN4llvm3orc34AbsoluteSymbolsMaterializationUnit11materializeESt10unique_ptrINS0_29MaterializationResponsibilityESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 22: _ZN4llvm3orc19MaterializationTask3runEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 23: _uncompressed_ir at ./runtime_internals.jl:1609 From worker 23: retrieve_ir_for_inlining at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:958 [inlined] From worker 23: resolve_todo at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:873 From worker 23: #analyze_method!#194 at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:954 From worker 23: analyze_method! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:921 [inlined] From worker 23: #handle_match!#197 at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1429 From worker 23: handle_match! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1421 [inlined] From worker 23: #handle_any_const_result!#195 at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1321 From worker 23: handle_any_const_result! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1309 [inlined] From worker 23: compute_inlining_cases at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1381 From worker 23: handle_call! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1413 [inlined] From worker 23: assemble_inline_todo! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:1664 From worker 23: ssa_inlining_pass! at ./../usr/share/julia/Compiler/src/ssair/inlining.jl:76 [inlined] From worker 23: run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1035 From worker 23: run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1048 [inlined] From worker 23: optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1021 From worker 23: jfptr_optimize_82646.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 22: work_until at /source/src/llvm-julia-task-dispatcher.h:382 From worker 22: wait at /source/src/llvm-julia-task-dispatcher.h:81 [inlined] From worker 22: get at /source/src/llvm-julia-task-dispatcher.h:168 [inlined] From worker 22: safelookup at /source/src/llvm-julia-task-dispatcher.h:434 From worker 22: findSymbols at /source/src/jitlayers.cpp:2154 From worker 22: jl_compile_codeinst_now at /source/src/jitlayers.cpp:725 From worker 22: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:232 From worker 23: jfptr_finish_nocycle_84627.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4528 From worker 23: const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1348 From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:898 From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 [inlined] From worker 23: handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:178 From worker 23: jfptr_handle1_80534.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: doworkloop at ./../usr/share/julia/Compiler/src/inferencestate.jl:1205 From worker 22: jl_compile_method_internal at /source/src/gf.c:3527 From worker 22: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4212 From worker 22: serialize_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:78 From worker 23: jfptr_doworkloop_84544.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4512 From worker 23: typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 From worker 23: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1561 [inlined] From worker 23: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 From worker 23: jfptr_typeinf_ext_toplevel_86144.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: jl_apply at /source/src/julia.h:2375 [inlined] From worker 23: jl_type_infer at /source/src/gf.c:462 From worker 23: jl_compile_method_internal at /source/src/gf.c:3514 From worker 23: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: summary at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:229 From worker 23: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:323 From worker 23: #952 at ./asyncmap.jl:96 From worker 23: unknown function (ip: 0x7cedb9bc46d6) at (unknown file) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 22: unknown function (ip: 0x745a097bfe66) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4212 From worker 22: jl_apply at /source/src/julia.h:2375 [inlined] From worker 22: jl_f_invokelatest at /source/src/builtins.c:877 From worker 23: jl_apply at /source/src/julia.h:2375 [inlined] From worker 23: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 23: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 23: unknown function (ip: 0x7cedb9bbb11f) at (unknown file) From worker 23: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: jl_apply at /source/src/julia.h:2375 [inlined] From worker 22: send_msg_ at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:181 From worker 22: send_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:122 [inlined] From worker 22: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:460 From worker 22: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 22: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 22: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 22: call_on_owner at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:565 [inlined] From worker 22: fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:656 From worker 22: unknown function (ip: 0x745a097bf162) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4212 From worker 22: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 22: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 22: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 22: #952 at ./asyncmap.jl:96 From worker 22: unknown function (ip: 0x745a097beca6) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4212 From worker 22: jl_apply at /source/src/julia.h:2375 [inlined] From worker 22: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 22: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 22: unknown function (ip: 0x745a097b7d7f) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4212 From worker 23: start_task at /source/src/task.c:1253 From worker 23: unknown function (ip: (nil)) at (unknown file) From worker 22: jl_apply at /source/src/julia.h:2375 [inlined] From worker 22: start_task at /source/src/task.c:1253 From worker 22: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 25: Precompiling packages... From worker 24: Precompiling packages... From worker 24: Memento Being precompiled by another process (pid: 777, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 25: 1858.8 ms ? Memento From worker 24: 5254.1 ms ✓ Memento From worker 24: Dispatcher Being precompiled by another process (pid: 777, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 25: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 25: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 25: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 25: 6416.4 ms ? Dispatcher From worker 24: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 24: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 24: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 24: 7457.2 ms ✓ Dispatcher From worker 24: 2 dependencies successfully precompiled in 13 seconds. 37 already precompiled. From worker 24: 2 dependencies had output during precompilation: From worker 24: ┌ Dispatcher From worker 24: │ [Output was shown above] From worker 24: └ From worker 24: ┌ Memento From worker 24: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 24: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 24: └ From worker 24: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 24: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 24: Precompiling packages... From worker 24: Info Given Memento was explicitly requested, output will be shown live  From worker 24: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 24: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 24: 4075.1 ms ? Memento From worker 25: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 25: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 25: Precompiling packages... From worker 25: Memento Being precompiled by another process (pid: 775, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 24: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 24: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 25: Info Given Memento was explicitly requested, output will be shown live  From worker 25: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 25: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 25: 5353.2 ms ✓ Memento From worker 25: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 25: 1 dependency had output during precompilation: From worker 25: ┌ Memento From worker 25: │ [Output was shown above] From worker 25: └ From worker 25: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 25: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 24 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 24 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 25 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 25 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 25: From worker 25: ====================================================================================== From worker 25: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 25: ====================================================================================== From worker 24: From worker 24: ====================================================================================== From worker 24: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 24: ====================================================================================== From worker 25: From worker 25: cmd: /opt/julia/bin/julia 777 running 1 of 1 From worker 25: From worker 25: signal (10): User defined signal 1 From worker 24: From worker 24: cmd: /opt/julia/bin/julia 775 running 1 of 1 From worker 24: From worker 24: signal (10): User defined signal 1 From worker 24: _ZN4llvm9MCContext13getELFSectionERKNS_5TwineEjjjPKNS_11MCSymbolELFEbjS6_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm16MCObjectFileInfo23initELFMCObjectFileInfoERKNS_6TripleEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm24TargetLoweringObjectFile10InitializeERNS_9MCContextERKNS_13TargetMachineE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm27TargetLoweringObjectFileELF10InitializeERNS_9MCContextERKNS_13TargetMachineE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm10AsmPrinter16doInitializationERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm13FPPassManager16doInitializationERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 24: operator() at /source/src/jitlayers.cpp:1612[info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. From worker 24: addModule at /source/src/jitlayers.cpp:2093 From worker 24: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 24: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 24: jl_compile_method_internal at /source/src/gf.c:3527 From worker 24: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 24: ijl_apply_generic at /source/src/gf.c:4212 From worker 24: summary at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:229 From worker 24: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:323 From worker 24: #952 at ./asyncmap.jl:96 From worker 24: unknown function (ip: 0x777584dc5d16) at (unknown file) From worker 24: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 24: ijl_apply_generic at /source/src/gf.c:4212 From worker 24: jl_apply at /source/src/julia.h:2375 [inlined] From worker 24: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 24: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 24: unknown function (ip: 0x777584db7caf) at (unknown file) From worker 24: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 24: ijl_apply_generic at /source/src/gf.c:4212 From worker 24: jl_apply at /source/src/julia.h:2375 [inlined] From worker 24: start_task at /source/src/task.c:1253 From worker 24: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 24 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 25 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 26: Precompiling packages... From worker 27: Precompiling packages... From worker 27: Memento Being precompiled by another process (pid: 839, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 26: 1801.8 ms ? Memento From worker 27: 4885.7 ms ✓ Memento From worker 27: Dispatcher Being precompiled by another process (pid: 839, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 26: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 26: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 26: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 26: 5827.3 ms ? Dispatcher From worker 27: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 27: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 27: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 27: 6949.9 ms ✓ Dispatcher From worker 27: 2 dependencies successfully precompiled in 13 seconds. 37 already precompiled. From worker 27: 2 dependencies had output during precompilation: From worker 27: ┌ Dispatcher From worker 27: │ [Output was shown above] From worker 27: └ From worker 27: ┌ Memento From worker 27: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 27: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 27: └ From worker 27: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 27: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 27: Precompiling packages... From worker 27: Info Given Memento was explicitly requested, output will be shown live  From worker 27: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 27: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 27: 4106.8 ms ? Memento From worker 26: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 26: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 26: Precompiling packages... From worker 26: Memento Being precompiled by another process (pid: 841, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 27: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 27: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 26: Info Given Memento was explicitly requested, output will be shown live  From worker 26: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 26: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 26: 5217.1 ms ✓ Memento From worker 26: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 26: 1 dependency had output during precompilation: From worker 26: ┌ Memento From worker 26: │ [Output was shown above] From worker 26: └ From worker 26: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 26: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 26 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 26 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 27 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 27 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 27: From worker 27: ====================================================================================== From worker 27: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 27: ====================================================================================== From worker 26: From worker 26: ====================================================================================== From worker 26: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 26: ====================================================================================== From worker 27: From worker 27: cmd: /opt/julia/bin/julia 841 running 1 of 1 From worker 27: From worker 27: signal (10): User defined signal 1 From worker 26: From worker 26: cmd: /opt/julia/bin/julia 839 running 1 of 1 From worker 26: From worker 26: signal (10): User defined signal 1 From worker 26: jl_lookup_generic_ at /source/src/gf.c:4128 [inlined] From worker 26: ijl_apply_generic at /source/src/gf.c:4208 From worker 27: _ZN12_GLOBAL__N_18Verifier11visitMDNodeERKN4llvm6MDNodeENS0_19AreDebugLocsAllowedE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN12_GLOBAL__N_18Verifier6verifyEv at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN4llvm12verifyModuleERKNS_6ModuleEPNS_11raw_ostreamEPb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN4llvm16VerifierAnalysis3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN4llvm6detail17AnalysisPassModelINS_6ModuleENS_16VerifierAnalysisENS_15AnalysisManagerIS2_JEE11InvalidatorEJEE3runERS2_RS5_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN4llvm15AnalysisManagerINS_6ModuleEJEE13getResultImplEPNS_11AnalysisKeyERS1_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: _ZN4llvm12VerifierPass3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 26: doworkloop at ./../usr/share/julia/Compiler/src/inferencestate.jl:1205 From worker 26: jfptr_doworkloop_84544.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 26: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 26: ijl_apply_generic at /source/src/gf.c:4212 From worker 26: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4512 From worker 26: typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1378 From worker 26: add_codeinsts_to_jit! at ./../usr/share/julia/Compiler/src/typeinfer.jl:1529 From worker 26: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1562 [inlined] From worker 26: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1570 From worker 26: jfptr_typeinf_ext_toplevel_86144.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 26: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 26: ijl_apply_generic at /source/src/gf.c:4212 From worker 26: jl_apply at /source/src/julia.h:2375 [inlined] From worker 26: jl_type_infer at /source/src/gf.c:462 From worker 26: jl_compile_method_internal at /source/src/gf.c:3514 From worker 26: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 26: ijl_apply_generic at /source/src/gf.c:4212 From worker 26: jl_apply at /source/src/julia.h:2375 [inlined] From worker 26: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 26: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 26: unknown function (ip: 0x791bcd928d9f) at (unknown file) From worker 26: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 26: ijl_apply_generic at /source/src/gf.c:4212 From worker 26: jl_apply at /source/src/julia.h:2375 [inlined] From worker 26: start_task at /source/src/task.c:1253 From worker 26: unknown function (ip: (nil)) at (unknown file) From worker 27: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 27: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 27: run at /source/src/pipeline.cpp:791 From worker 27: operator() at /source/src/jitlayers.cpp:1510 From worker 27: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 27: operator() at /source/src/jitlayers.cpp:1471 [inlined] From worker 27: operator() at /source/src/jitlayers.cpp:1623 [inlined] From worker 27: addModule at /source/src/jitlayers.cpp:2080 From worker 27: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 27: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 27: jl_compile_method_internal at /source/src/gf.c:3527 From worker 27: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 27: ijl_apply_generic at /source/src/gf.c:4212 From worker 27: map at ./abstractarray.jl:3386 From worker 27: unknown function (ip: 0x7f349ddc6446) at (unknown file) From worker 27: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 27: ijl_apply_generic at /source/src/gf.c:4212 From worker 27: summary at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:229 From worker 27: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:323 From worker 27: #952 at ./asyncmap.jl:96 From worker 27: unknown function (ip: 0x7f349ddc6106) at (unknown file) From worker 27: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 27: ijl_apply_generic at /source/src/gf.c:4212 From worker 27: jl_apply at /source/src/julia.h:2375 [inlined] From worker 27: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 27: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 27: unknown function (ip: 0x7f349ddbcb4f) at (unknown file) From worker 27: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 27: ijl_apply_generic at /source/src/gf.c:4212 From worker 27: jl_apply at /source/src/julia.h:2375 [inlined] From worker 27: start_task at /source/src/task.c:1253 From worker 27: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 26 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 27 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 28: Precompiling packages... From worker 29: Precompiling packages... From worker 29: Memento Being precompiled by another process (pid: 903, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 28: 2195.5 ms ? Memento From worker 29: 6321.2 ms ✓ Memento From worker 29: Dispatcher Being precompiled by another process (pid: 903, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 28: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 28: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 28: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 28: 7856.6 ms ? Dispatcher From worker 29: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 29: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 29: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 29: 9543.8 ms ✓ Dispatcher From worker 29: 2 dependencies successfully precompiled in 17 seconds. 37 already precompiled. From worker 29: 2 dependencies had output during precompilation: From worker 29: ┌ Dispatcher From worker 29: │ [Output was shown above] From worker 29: └ From worker 29: ┌ Memento From worker 29: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 29: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 29: └ From worker 28: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 28: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 28: Precompiling packages... From worker 28: Info Given Memento was explicitly requested, output will be shown live  From worker 28: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 28: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 28: 4070.5 ms ? Memento From worker 29: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 29: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 29: Precompiling packages... From worker 29: Memento Being precompiled by another process (pid: 903, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 28: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 28: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 29: Info Given Memento was explicitly requested, output will be shown live  From worker 29: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 29: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 29: 5109.9 ms ✓ Memento From worker 29: 1 dependency successfully precompiled in 5 seconds. 14 already precompiled. From worker 29: 1 dependency had output during precompilation: From worker 29: ┌ Memento From worker 29: │ [Output was shown above] From worker 29: └ From worker 29: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 29: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 28 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 28 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 29 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 29 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:756 From worker 28: From worker 28: ====================================================================================== From worker 28: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 28: ====================================================================================== From worker 29: From worker 29: ====================================================================================== From worker 29: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 29: ====================================================================================== From worker 28: From worker 28: cmd: /opt/julia/bin/julia 903 running 1 of 1 From worker 28: From worker 28: signal (10): User defined signal 1 From worker 29: From worker 29: cmd: /opt/julia/bin/julia 904 running 1 of 1 From worker 29: From worker 29: signal (10): User defined signal 1 From worker 29: unknown function (ip: 0x7360ec25e9c8) at /lib/x86_64-linux-gnu/libc.so.6 From worker 28: _ZN12_GLOBAL__N_115MachineCombiner19combineInstructionsEPN4llvm17MachineBasicBlockE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN12_GLOBAL__N_115MachineCombiner20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm15SmallVectorImplIjEaSERKS1_.isra.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass10ValueTable20assignExpNewValueNumERNS0_10ExpressionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass17propagateEqualityEPNS_5ValueES2_RKNS_14BasicBlockEdgeEb at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass18processInstructionEPNS_11InstructionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass12processBlockEPNS_10BasicBlockE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass17iterateOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass7runImplERNS_8FunctionERNS_15AssumptionCacheERNS_13DominatorTreeERKNS_17TargetLibraryInfoERNS_9AAResultsEPNS_23MemoryDependenceResultsERNS_8LoopInfoEPNS_25OptimizationRemarkEmitterEPNS_9MemorySSAE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: _ZN4llvm7GVNPass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 28: operator() at /source/src/jitlayers.cpp:1612 From worker 28: addModule at /source/src/jitlayers.cpp:2093 From worker 28: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 28: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 28: jl_compile_method_internal at /source/src/gf.c:3527 From worker 29: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 28: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 28: ijl_apply_generic at /source/src/gf.c:4212 From worker 28: serialize_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:78 From worker 28: unknown function (ip: 0x724006194396) at (unknown file) From worker 28: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 28: ijl_apply_generic at /source/src/gf.c:4212 From worker 28: jl_apply at /source/src/julia.h:2375 [inlined] From worker 29: _ZN4llvm11PassManagerINS_8FunctionENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 29: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91 From worker 29: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.20.1jl (unknown line) From worker 29: run at /source/src/pipeline.cpp:791 From worker 28: jl_f_invokelatest at /source/src/builtins.c:877 From worker 28: send_msg_ at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:181 From worker 28: send_msg at /source/usr/share/julia/stdlib/v1.13/Distributed/src/messages.jl:122 [inlined] From worker 28: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:460 From worker 28: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 28: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 28: remotecall_fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 28: call_on_owner at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:565 [inlined] From worker 28: fetch at /source/usr/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:656 From worker 28: unknown function (ip: 0x724006193c62) at (unknown file) From worker 28: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 28: ijl_apply_generic at /source/src/gf.c:4212 From worker 28: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 28: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 28: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 28: #952 at ./asyncmap.jl:96 From worker 28: unknown function (ip: 0x724006192f56) at (unknown file) From worker 28: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 28: ijl_apply_generic at /source/src/gf.c:4212 From worker 28: jl_apply at /source/src/julia.h:2375 [inlined] From worker 28: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 28: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 28: unknown function (ip: 0x72400618c29f) at (unknown file) From worker 28: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 28: ijl_apply_generic at /source/src/gf.c:4212 From worker 28: jl_apply at /source/src/julia.h:2375 [inlined] From worker 28: start_task at /source/src/task.c:1253 From worker 28: unknown function (ip: (nil)) at (unknown file) From worker 29: operator() at /source/src/jitlayers.cpp:1510 From worker 29: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 29: operator() at /source/src/jitlayers.cpp:1471 [inlined] From worker 29: operator() at /source/src/jitlayers.cpp:1623 [inlined] From worker 29: addModule at /source/src/jitlayers.cpp:2080 From worker 29: jl_compile_codeinst_now at /source/src/jitlayers.cpp:682 From worker 29: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:873 From worker 29: jl_compile_method_internal at /source/src/gf.c:3527 From worker 29: _jl_invoke at /source/src/gf.c:4007 [inlined] From worker 29: ijl_apply_generic at /source/src/gf.c:4212 From worker 29: _atexit at ./initdefs.jl:464 From worker 29: jfptr__atexit_32884.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 29: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 29: ijl_apply_generic at /source/src/gf.c:4212 From worker 29: jl_apply at /source/src/julia.h:2375 [inlined] From worker 29: ijl_atexit_hook at /source/src/init.c:260 From worker 29: ijl_exit at /source/src/init.c:196 From worker 29: jlplt_ijl_exit_44908.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 29: exit at ./initdefs.jl:28 From worker 29: exit at ./initdefs.jl:29 From worker 29: jfptr_exit_60072.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 29: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 29: ijl_apply_generic at /source/src/gf.c:4212 From worker 29: jl_apply at /source/src/julia.h:2375 [inlined] From worker 29: jl_f_invokelatest at /source/src/builtins.c:877 From worker 29: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 29: ijl_apply_generic at /source/src/gf.c:4212 From worker 29: jl_apply at /source/src/julia.h:2375 [inlined] From worker 29: jl_f__apply_iterate at /source/src/builtins.c:864 From worker 29: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 29: run_work_thunk at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 29: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:310 From worker 29: unknown function (ip: 0x7360eab6338f) at (unknown file) From worker 29: _jl_invoke at /source/src/gf.c:4015 [inlined] From worker 29: ijl_apply_generic at /source/src/gf.c:4212 From worker 29: jl_apply at /source/src/julia.h:2375 [inlined] From worker 29: start_task at /source/src/task.c:1253 From worker 29: unknown function (ip: (nil)) at (unknown file) [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:99 │ [3] send_msg_now │ @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 28 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 29 └ @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/managers.jl:760 From worker 31: Precompiling packages... From worker 32: Precompiling packages... From worker 30: Precompiling packages... From worker 32: Memento Being precompiled by another process (pid: 969, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 30: Memento Being precompiled by another process (pid: 969, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 31: 2809.7 ms ? Memento From worker 32: 6819.9 ms ✓ Memento From worker 32: Dispatcher Being precompiled by another process (pid: 969, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 30: 11010.0 ms ✓ Memento From worker 30: Dispatcher Being precompiled by another process (pid: 969, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 31: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 31: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 31: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 31: 10226.1 ms ? Dispatcher From worker 30: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 30: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 30: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 30: 7874.9 ms ✓ Dispatcher From worker 30: 2 dependencies successfully precompiled in 20 seconds. 37 already precompiled. From worker 30: 2 dependencies had output during precompilation: From worker 30: ┌ Dispatcher From worker 30: │ [Output was shown above] From worker 30: └ From worker 30: ┌ Memento From worker 30: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 30: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 30: └ From worker 32: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 32: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 32: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 32: 17787.0 ms ✓ Dispatcher From worker 32: 2 dependencies successfully precompiled in 26 seconds. 37 already precompiled. From worker 32: 2 dependencies had output during precompilation: From worker 32: ┌ Dispatcher From worker 32: │ [Output was shown above] From worker 32: └ From worker 32: ┌ Memento From worker 32: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 32: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 32: └ From worker 31: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 31: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 31: Precompiling packages... From worker 31: Info Given Memento was explicitly requested, output will be shown live  From worker 31: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 31: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 31: 3937.2 ms ? Memento From worker 30: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 30: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 30: Precompiling packages... From worker 30: Memento Being precompiled by another process (pid: 969, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 31: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 31: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 30: Info Given Memento was explicitly requested, output will be shown live  From worker 30: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 30: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 30: 8089.0 ms ✓ Memento From worker 30: 1 dependency successfully precompiled in 8 seconds. 14 already precompiled. From worker 30: 1 dependency had output during precompilation: From worker 30: ┌ Memento From worker 30: │ [Output was shown above] From worker 30: └ From worker 32: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 32: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 32: Precompiling packages... From worker 32: Info Given Memento was explicitly requested, output will be shown live  From worker 32: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 32: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 32: 3311.6 ms ? Memento From worker 30: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 30: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 32: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 32: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 3 graph nodes. [info | Dispatcher]: Node 1 (Op, Int64>): running. [info | Dispatcher]: Node 2 (Op>): running. [info | Dispatcher]: Node 3 (Op): running. [info | Dispatcher]: Node 3 (Op): complete. [info | Dispatcher]: Node 2 (Op>): complete. [info | Dispatcher]: Node 1 (Op, Int64>): complete. [info | Dispatcher]: All 3 nodes executed. From worker 35: Precompiling packages... From worker 34: Precompiling packages... From worker 33: Precompiling packages... From worker 34: Memento Being precompiled by another process (pid: 1066, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 33: Memento Being precompiled by another process (pid: 1066, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 35: 2681.4 ms ? Memento From worker 33: 6904.6 ms ✓ Memento From worker 33: Dispatcher Being precompiled by another process (pid: 1066, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 34: 11123.6 ms ✓ Memento From worker 34: Dispatcher Being precompiled by another process (pid: 1066, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 35: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 35: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 35: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 35: 10263.1 ms ? Dispatcher From worker 34: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 34: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 34: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 34: 7566.1 ms ✓ Dispatcher From worker 34: 2 dependencies successfully precompiled in 20 seconds. 37 already precompiled. From worker 34: 2 dependencies had output during precompilation: From worker 34: ┌ Dispatcher From worker 34: │ [Output was shown above] From worker 34: └ From worker 34: ┌ Memento From worker 34: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 34: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 34: └ From worker 33: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 33: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 33: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 33: 17478.7 ms ✓ Dispatcher From worker 33: 2 dependencies successfully precompiled in 26 seconds. 37 already precompiled. From worker 33: 2 dependencies had output during precompilation: From worker 33: ┌ Dispatcher From worker 33: │ [Output was shown above] From worker 33: └ From worker 33: ┌ Memento From worker 33: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 33: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 33: └ From worker 35: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 35: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 35: Precompiling packages... From worker 35: Info Given Memento was explicitly requested, output will be shown live  From worker 35: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 35: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 35: 4070.4 ms ? Memento From worker 34: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 34: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 34: Precompiling packages... From worker 34: Memento Being precompiled by another process (pid: 1066, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 35: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 35: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 34: Info Given Memento was explicitly requested, output will be shown live  From worker 34: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 34: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 34: 8714.5 ms ✓ Memento From worker 34: 1 dependency successfully precompiled in 9 seconds. 14 already precompiled. From worker 34: 1 dependency had output during precompilation: From worker 34: ┌ Memento From worker 34: │ [Output was shown above] From worker 34: └ From worker 33: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 33: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 33: Precompiling packages... From worker 33: Info Given Memento was explicitly requested, output will be shown live  From worker 33: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 33: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 33: 4740.1 ms ? Memento From worker 34: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 34: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 33: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 33: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 3 graph nodes. [info | Dispatcher]: Node 1 (Op, Int64>): running. [info | Dispatcher]: Node 2 (Op>): running. [info | Dispatcher]: Node 3 (Op): running. [info | Dispatcher]: Node 3 (Op): complete. [info | Dispatcher]: Node 2 (Op>): complete. [info | Dispatcher]: Node 1 (Op, Int64>): complete. [info | Dispatcher]: All 3 nodes executed. [info | Dispatcher]: Executing 13 graph nodes. [info | Dispatcher]: Node 1 (Op<+, Op, Op, Op>): running. [info | Dispatcher]: Node 2 (Op, Op, Op>): running. [info | Dispatcher]: Node 3 (Op, Op, Op>): running. [info | Dispatcher]: Node 4 (Op, Op, Op>): running. [info | Dispatcher]: Node 5 (Op, Int64>): running. [info | Dispatcher]: Node 6 (Op, Int64>): running. [info | Dispatcher]: Node 7 (Op, Int64>): running. [info | Dispatcher]: Node 8 (Op): running. [info | Dispatcher]: Node 9 (Op): running. [info | Dispatcher]: Node 10 (Op): running. [info | Dispatcher]: Node 11 (Op, Int64>): running. [info | Dispatcher]: Node 12 (Op, Int64>): running. [info | Dispatcher]: Node 13 (Op, Int64>): running. [info | Dispatcher]: Node 8 (Op): complete. [info | Dispatcher]: Node 9 (Op): complete. [info | Dispatcher]: Node 7 (Op, Int64>): complete. [info | Dispatcher]: Node 10 (Op): complete. [info | Dispatcher]: Node 6 (Op, Int64>): complete. [info | Dispatcher]: Node 2 (Op, Op, Op>): complete. [info | Dispatcher]: Node 5 (Op, Int64>): complete. [info | Dispatcher]: Node 11 (Op, Int64>): complete. [info | Dispatcher]: Node 12 (Op, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op, Op>): complete. [info | Dispatcher]: Node 13 (Op, Int64>): complete. [info | Dispatcher]: Node 3 (Op, Op, Op>): complete. [info | Dispatcher]: Node 1 (Op<+, Op, Op, Op>): complete. [info | Dispatcher]: All 13 nodes executed. From worker 38: Precompiling packages... From worker 36: Precompiling packages... From worker 37: Precompiling packages... From worker 36: Memento Being precompiled by another process (pid: 1162, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 37: Memento Being precompiled by another process (pid: 1162, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 38: 3223.9 ms ? Memento From worker 37: 6774.7 ms ✓ Memento From worker 37: Dispatcher Being precompiled by another process (pid: 1162, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 36: 11083.5 ms ✓ Memento From worker 36: Dispatcher Being precompiled by another process (pid: 1162, pidfile: /home/pkgeval/.julia/compiled/v1.13/Dispatcher/jfGZw_eJM3J.ji.pidfile) From worker 38: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 38: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 38: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 38: 10178.2 ms ? Dispatcher From worker 36: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 36: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 36: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 36: 8331.6 ms ✓ Dispatcher From worker 36: 2 dependencies successfully precompiled in 21 seconds. 37 already precompiled. From worker 36: 2 dependencies had output during precompilation: From worker 36: ┌ Dispatcher From worker 36: │ [Output was shown above] From worker 36: └ From worker 36: ┌ Memento From worker 36: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 36: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 36: └ From worker 37: Info Given Dispatcher was explicitly requested, output will be shown live  From worker 37: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 37: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 37: 18550.1 ms ✓ Dispatcher From worker 37: 2 dependencies successfully precompiled in 27 seconds. 37 already precompiled. From worker 37: 2 dependencies had output during precompilation: From worker 37: ┌ Dispatcher From worker 37: │ [Output was shown above] From worker 37: └ From worker 37: ┌ Memento From worker 37: │ WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 37: │ ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 37: └ From worker 36: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 36: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 36: Precompiling packages... From worker 36: Info Given Memento was explicitly requested, output will be shown live  From worker 36: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 36: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 36: 3998.3 ms ? Memento From worker 38: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 38: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 38: Precompiling packages... From worker 38: Memento Being precompiled by another process (pid: 1159, pidfile: /home/pkgeval/.julia/compiled/v1.13/Memento/fk6ge_eJM3J.ji.pidfile) From worker 36: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 36: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 38: Info Given Memento was explicitly requested, output will be shown live  From worker 38: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 38: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 38: 7926.4 ms ✓ Memento From worker 38: 1 dependency successfully precompiled in 8 seconds. 14 already precompiled. From worker 38: 1 dependency had output during precompilation: From worker 38: ┌ Memento From worker 38: │ [Output was shown above] From worker 38: └ From worker 37: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 37: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 37: Precompiling packages... From worker 37: Info Given Memento was explicitly requested, output will be shown live  From worker 37: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 37: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 37: 3462.1 ms ? Memento From worker 38: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 38: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. From worker 37: WARNING: Method definition var"@test_throws"(LineNumberNode, Module, Any, Any, Any) in module Test at /source/usr/share/julia/stdlib/v1.13/Test/src/Test.jl:868 overwritten in module TestUtils at /home/pkgeval/.julia/packages/Memento/xnHxE/src/memento_test.jl:119. From worker 37: ERROR: Method overwriting is not permitted during Module precompilation. Use `__precompile__(false)` to opt-out of precompilation. [info | Dispatcher]: Executing 499 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (CollectNode<200 Ops>): running. [info | Dispatcher]: Node 3 (Op, Op>): running. [info | Dispatcher]: Node 4 (Op, Op>): running. [info | Dispatcher]: Node 5 (Op, Op>): running. [info | Dispatcher]: Node 6 (Op, Op>): running. [info | Dispatcher]: Node 7 (Op, Op>): running. [info | Dispatcher]: Node 8 (Op, Op>): running. [info | Dispatcher]: Node 9 (Op, Op>): running. [info | Dispatcher]: Node 10 (Op, Op>): running. [info | Dispatcher]: Node 11 (Op, Op>): running. [info | Dispatcher]: Node 12 (Op, Op>): running. [info | Dispatcher]: Node 13 (Op, Op>): running. [info | Dispatcher]: Node 14 (Op, Op>): running. [info | Dispatcher]: Node 15 (Op, Op>): running. [info | Dispatcher]: Node 16 (Op, Op>): running. [info | Dispatcher]: Node 17 (Op, Op>): running. [info | Dispatcher]: Node 18 (Op, Op>): running. [info | Dispatcher]: Node 19 (Op, Op>): running. [info | Dispatcher]: Node 20 (Op, Op>): running. [info | Dispatcher]: Node 21 (Op, Op>): running. [info | Dispatcher]: Node 22 (Op, Op>): running. [info | Dispatcher]: Node 23 (Op, Op>): running. [info | Dispatcher]: Node 24 (Op, Op>): running. [info | Dispatcher]: Node 25 (Op, Op>): running. [info | Dispatcher]: Node 26 (Op, Op>): running. [info | Dispatcher]: Node 27 (Op, Op>): running. [info | Dispatcher]: Node 28 (Op, Op>): running. [info | Dispatcher]: Node 29 (Op, Op>): running. [info | Dispatcher]: Node 30 (Op, Op>): running. [info | Dispatcher]: Node 31 (Op, Op>): running. [info | Dispatcher]: Node 32 (Op, Op>): running. [info | Dispatcher]: Node 33 (Op, Op>): running. [info | Dispatcher]: Node 34 (Op, Op>): running. [info | Dispatcher]: Node 35 (Op, Op>): running. [info | Dispatcher]: Node 36 (Op, Op>): running. [info | Dispatcher]: Node 37 (Op, Op>): running. [info | Dispatcher]: Node 38 (Op, Op>): running. [info | Dispatcher]: Node 39 (Op, Op>): running. [info | Dispatcher]: Node 40 (Op, Op>): running. [info | Dispatcher]: Node 41 (Op, Op>): running. [info | Dispatcher]: Node 42 (Op, Op>): running. [info | Dispatcher]: Node 43 (Op, Op>): running. [info | Dispatcher]: Node 44 (Op, Op>): running. [info | Dispatcher]: Node 45 (Op, Op>): running. [info | Dispatcher]: Node 46 (Op, Op>): running. [info | Dispatcher]: Node 47 (Op, Op>): running. [info | Dispatcher]: Node 48 (Op, Op>): running. [info | Dispatcher]: Node 49 (Op, Op>): running. [info | Dispatcher]: Node 50 (Op, Op>): running. [info | Dispatcher]: Node 51 (Op, Op>): running. [info | Dispatcher]: Node 52 (Op, Op>): running. [info | Dispatcher]: Node 53 (Op, Op>): running. [info | Dispatcher]: Node 54 (Op, Op>): running. [info | Dispatcher]: Node 55 (Op, Op>): running. [info | Dispatcher]: Node 56 (Op, Op>): running. [info | Dispatcher]: Node 57 (Op, Op>): running. [info | Dispatcher]: Node 58 (Op, Op>): running. [info | Dispatcher]: Node 59 (Op, Op>): running. [info | Dispatcher]: Node 60 (Op, Op>): running. [info | Dispatcher]: Node 61 (Op, Op>): running. [info | Dispatcher]: Node 62 (Op, Op>): running. [info | Dispatcher]: Node 63 (Op, Op>): running. [info | Dispatcher]: Node 64 (Op, Op>): running. [info | Dispatcher]: Node 65 (Op, Op>): running. [info | Dispatcher]: Node 66 (Op, Op>): running. [info | Dispatcher]: Node 67 (Op, Op>): running. [info | Dispatcher]: Node 68 (Op, Op>): running. [info | Dispatcher]: Node 69 (Op, Op>): running. [info | Dispatcher]: Node 70 (Op, Op>): running. [info | Dispatcher]: Node 71 (Op, Op>): running. [info | Dispatcher]: Node 72 (Op, Op>): running. [info | Dispatcher]: Node 73 (Op, Op>): running. [info | Dispatcher]: Node 74 (Op, Op>): running. [info | Dispatcher]: Node 75 (Op, Op>): running. [info | Dispatcher]: Node 76 (Op, Op>): running. [info | Dispatcher]: Node 77 (Op, Op>): running. [info | Dispatcher]: Node 78 (Op, Op>): running. [info | Dispatcher]: Node 79 (Op, Op>): running. [info | Dispatcher]: Node 80 (Op, Op>): running. [info | Dispatcher]: Node 81 (Op, Op>): running. [info | Dispatcher]: Node 82 (Op, Op>): running. [info | Dispatcher]: Node 83 (Op, Op>): running. [info | Dispatcher]: Node 84 (Op, Op>): running. [info | Dispatcher]: Node 85 (Op, Op>): running. [info | Dispatcher]: Node 86 (Op, Op>): running. [info | Dispatcher]: Node 87 (Op, Op>): running. [info | Dispatcher]: Node 88 (Op, Op>): running. [info | Dispatcher]: Node 89 (Op, Op>): running. [info | Dispatcher]: Node 90 (Op, Op>): running. [info | Dispatcher]: Node 91 (Op, Op>): running. [info | Dispatcher]: Node 92 (Op, Op>): running. [info | Dispatcher]: Node 93 (Op, Op>): running. [info | Dispatcher]: Node 94 (Op, Op>): running. [info | Dispatcher]: Node 95 (Op, Op>): running. [info | Dispatcher]: Node 96 (Op, Op>): running. [info | Dispatcher]: Node 97 (Op, Op>): running. [info | Dispatcher]: Node 98 (Op, Op>): running. [info | Dispatcher]: Node 99 (Op, Op>): running. [info | Dispatcher]: Node 100 (Op, Op>): running. [info | Dispatcher]: Node 101 (Op, Op>): running. [info | Dispatcher]: Node 102 (Op, Op>): running. [info | Dispatcher]: Node 103 (Op, Op>): running. [info | Dispatcher]: Node 104 (Op, Op>): running. [info | Dispatcher]: Node 105 (Op, Op>): running. [info | Dispatcher]: Node 106 (Op, Op>): running. [info | Dispatcher]: Node 107 (Op, Op>): running. [info | Dispatcher]: Node 108 (Op, Op>): running. [info | Dispatcher]: Node 109 (Op, Op>): running. [info | Dispatcher]: Node 110 (Op, Op>): running. [info | Dispatcher]: Node 111 (Op, Op>): running. [info | Dispatcher]: Node 112 (Op, Op>): running. [info | Dispatcher]: Node 113 (Op, Op>): running. [info | Dispatcher]: Node 114 (Op, Op>): running. [info | Dispatcher]: Node 115 (Op, Op>): running. [info | Dispatcher]: Node 116 (Op, Op>): running. [info | Dispatcher]: Node 117 (Op, Op>): running. [info | Dispatcher]: Node 118 (Op, Op>): running. [info | Dispatcher]: Node 119 (Op, Op>): running. [info | Dispatcher]: Node 120 (Op, Op>): running. [info | Dispatcher]: Node 121 (Op, Op>): running. [info | Dispatcher]: Node 122 (Op, Op>): running. [info | Dispatcher]: Node 123 (Op, Op>): running. [info | Dispatcher]: Node 124 (Op, Op>): running. [info | Dispatcher]: Node 125 (Op, Op>): running. [info | Dispatcher]: Node 126 (Op, Op>): running. [info | Dispatcher]: Node 127 (Op, Op>): running. [info | Dispatcher]: Node 128 (Op, Op>): running. [info | Dispatcher]: Node 129 (Op, Op>): running. [info | Dispatcher]: Node 130 (Op, Op>): running. [info | Dispatcher]: Node 131 (Op, Op>): running. [info | Dispatcher]: Node 132 (Op, Op>): running. [info | Dispatcher]: Node 133 (Op, Op>): running. [info | Dispatcher]: Node 134 (Op, Op>): running. [info | Dispatcher]: Node 135 (Op, Op>): running. [info | Dispatcher]: Node 136 (Op, Op>): running. [info | Dispatcher]: Node 137 (Op, Op>): running. [info | Dispatcher]: Node 138 (Op, Op>): running. [info | Dispatcher]: Node 139 (Op, Op>): running. [info | Dispatcher]: Node 140 (Op, Op>): running. [info | Dispatcher]: Node 141 (Op, Op>): running. [info | Dispatcher]: Node 142 (Op, Op>): running. [info | Dispatcher]: Node 143 (Op, Op>): running. [info | Dispatcher]: Node 144 (Op, Op>): running. [info | Dispatcher]: Node 145 (Op, Op>): running. [info | Dispatcher]: Node 146 (Op, Op>): running. [info | Dispatcher]: Node 147 (Op, Op>): running. [info | Dispatcher]: Node 148 (Op, Op>): running. [info | Dispatcher]: Node 149 (Op, Op>): running. [info | Dispatcher]: Node 150 (Op, Op>): running. [info | Dispatcher]: Node 151 (Op, Op>): running. [info | Dispatcher]: Node 152 (Op, Op>): running. [info | Dispatcher]: Node 153 (Op, Op>): running. [info | Dispatcher]: Node 154 (Op, Op>): running. [info | Dispatcher]: Node 155 (Op, Op>): running. [info | Dispatcher]: Node 156 (Op, Op>): running. [info | Dispatcher]: Node 157 (Op, Op>): running. [info | Dispatcher]: Node 158 (Op, Op>): running. [info | Dispatcher]: Node 159 (Op, Op>): running. [info | Dispatcher]: Node 160 (Op, Op>): running. [info | Dispatcher]: Node 161 (Op, Op>): running. [info | Dispatcher]: Node 162 (Op, Op>): running. [info | Dispatcher]: Node 163 (Op, Op>): running. [info | Dispatcher]: Node 164 (Op, Op>): running. [info | Dispatcher]: Node 165 (Op, Op>): running. [info | Dispatcher]: Node 166 (Op, Op>): running. [info | Dispatcher]: Node 167 (Op, Op>): running. [info | Dispatcher]: Node 168 (Op, Op>): running. [info | Dispatcher]: Node 169 (Op, Op>): running. [info | Dispatcher]: Node 170 (Op, Op>): running. [info | Dispatcher]: Node 171 (Op, Op>): running. [info | Dispatcher]: Node 172 (Op, Op>): running. [info | Dispatcher]: Node 173 (Op, Op>): running. [info | Dispatcher]: Node 174 (Op, Op>): running. [info | Dispatcher]: Node 175 (Op, Op>): running. [info | Dispatcher]: Node 176 (Op, Op>): running. [info | Dispatcher]: Node 177 (Op, Op>): running. [info | Dispatcher]: Node 178 (Op, Op>): running. [info | Dispatcher]: Node 179 (Op, Op>): running. [info | Dispatcher]: Node 180 (Op, Op>): running. [info | Dispatcher]: Node 181 (Op, Op>): running. [info | Dispatcher]: Node 182 (Op, Op>): running. [info | Dispatcher]: Node 183 (Op, Op>): running. [info | Dispatcher]: Node 184 (Op, Op>): running. [info | Dispatcher]: Node 185 (Op, Op>): running. [info | Dispatcher]: Node 186 (Op, Op>): running. [info | Dispatcher]: Node 187 (Op, Op>): running. [info | Dispatcher]: Node 188 (Op, Op>): running. [info | Dispatcher]: Node 189 (Op, Op>): running. [info | Dispatcher]: Node 190 (Op, Op>): running. [info | Dispatcher]: Node 191 (Op, Op>): running. [info | Dispatcher]: Node 192 (Op, Op>): running. [info | Dispatcher]: Node 193 (Op, Op>): running. [info | Dispatcher]: Node 194 (Op, Op>): running. [info | Dispatcher]: Node 195 (Op, Op>): running. [info | Dispatcher]: Node 196 (Op, Op>): running. [info | Dispatcher]: Node 197 (Op, Op>): running. [info | Dispatcher]: Node 198 (Op, Op>): running. [info | Dispatcher]: Node 199 (Op, Op>): running. [info | Dispatcher]: Node 200 (Op, Op>): running. [info | Dispatcher]: Node 201 (Op, Op>): running. [info | Dispatcher]: Node 202 (Op, Op>): running. [info | Dispatcher]: Node 203 (Op, Op, Op>): running. [info | Dispatcher]: Node 204 (Op, Op, Op>): running. [info | Dispatcher]: Node 205 (Op, Op>): running. [info | Dispatcher]: Node 206 (Op, Op>): running. [info | Dispatcher]: Node 207 (Op, Op>): running. [info | Dispatcher]: Node 208 (Op): running. [info | Dispatcher]: Node 209 (Op): running. [info | Dispatcher]: Node 210 (Op): running. [info | Dispatcher]: Node 211 (Op): running. [info | Dispatcher]: Node 212 (Op, Op>): running. [info | Dispatcher]: Node 213 (Op, Op>): running. [info | Dispatcher]: Node 214 (Op, Op>): running. [info | Dispatcher]: Node 215 (Op): running. [info | Dispatcher]: Node 216 (Op): running. [info | Dispatcher]: Node 217 (Op): running. [info | Dispatcher]: Node 218 (Op, Op, Op>): running. [info | Dispatcher]: Node 219 (Op, Op, Op>): running. [info | Dispatcher]: Node 220 (Op, Op>): running. [info | Dispatcher]: Node 221 (Op, Op>): running. [info | Dispatcher]: Node 222 (Op, Op>): running. [info | Dispatcher]: Node 223 (Op): running. [info | Dispatcher]: Node 224 (Op): running. [info | Dispatcher]: Node 225 (Op): running. [info | Dispatcher]: Node 226 (Op, Op>): running. [info | Dispatcher]: Node 227 (Op, Op>): running. [info | Dispatcher]: Node 228 (Op, Op>): running. [info | Dispatcher]: Node 229 (Op): running. [info | Dispatcher]: Node 230 (Op): running. [info | Dispatcher]: Node 231 (Op): running. [info | Dispatcher]: Node 232 (Op, Op, Op>): running. [info | Dispatcher]: Node 233 (Op, Op, Op>): running. [info | Dispatcher]: Node 234 (Op, Op>): running. [info | Dispatcher]: Node 235 (Op, Op>): running. [info | Dispatcher]: Node 236 (Op, Op>): running. [info | Dispatcher]: Node 237 (Op): running. [info | Dispatcher]: Node 238 (Op): running. [info | Dispatcher]: Node 239 (Op): running. [info | Dispatcher]: Node 240 (Op, Op>): running. [info | Dispatcher]: Node 241 (Op, Op>): running. [info | Dispatcher]: Node 242 (Op, Op>): running. [info | Dispatcher]: Node 243 (Op): running. [info | Dispatcher]: Node 244 (Op): running. [info | Dispatcher]: Node 245 (Op): running. [info | Dispatcher]: Node 246 (Op, Op, Op>): running. [info | Dispatcher]: Node 247 (Op, Op, Op>): running. [info | Dispatcher]: Node 248 (Op, Op>): running. [info | Dispatcher]: Node 249 (Op): running. [info | Dispatcher]: Node 250 (Op, Op>): running. [info | Dispatcher]: Node 251 (Op, Op>): running. [info | Dispatcher]: Node 252 (Op, Op>): running. [info | Dispatcher]: Node 253 (Op): running. [info | Dispatcher]: Node 254 (Op): running. [info | Dispatcher]: Node 255 (Op): running. [info | Dispatcher]: Node 256 (Op, Op, Op>): running. [info | Dispatcher]: Node 257 (Op, Op, Op>): running. [info | Dispatcher]: Node 258 (Op, Op>): running. [info | Dispatcher]: Node 259 (Op): running. [info | Dispatcher]: Node 260 (Op, Op>): running. [info | Dispatcher]: Node 261 (Op, Op>): running. [info | Dispatcher]: Node 262 (Op): running. [info | Dispatcher]: Node 263 (Op): running. [info | Dispatcher]: Node 264 (Op, Op, Op>): running. [info | Dispatcher]: Node 265 (Op, Op, Op>): running. [info | Dispatcher]: Node 266 (Op, Op>): running. [info | Dispatcher]: Node 267 (Op, Op>): running. [info | Dispatcher]: Node 268 (Op, Op>): running. [info | Dispatcher]: Node 269 (Op): running. [info | Dispatcher]: Node 270 (Op): running. [info | Dispatcher]: Node 271 (Op): running. [info | Dispatcher]: Node 272 (Op, Op>): running. [info | Dispatcher]: Node 273 (Op, Op>): running. [info | Dispatcher]: Node 274 (Op, Op>): running. [info | Dispatcher]: Node 275 (Op): running. [info | Dispatcher]: Node 276 (Op): running. [info | Dispatcher]: Node 277 (Op): running. [info | Dispatcher]: Node 278 (Op, Op, Op>): running. [info | Dispatcher]: Node 279 (Op, Op>): running. [info | Dispatcher]: Node 280 (Op, Op>): running. [info | Dispatcher]: Node 281 (Op, Op>): running. [info | Dispatcher]: Node 282 (Op): running. [info | Dispatcher]: Node 283 (Op): running. [info | Dispatcher]: Node 284 (Op): running. [info | Dispatcher]: Node 285 (Op, Op, Op>): running. [info | Dispatcher]: Node 286 (Op, Op, Op>): running. [info | Dispatcher]: Node 287 (Op, Op>): running. [info | Dispatcher]: Node 288 (Op, Op>): running. [info | Dispatcher]: Node 289 (Op, Op>): running. [info | Dispatcher]: Node 290 (Op): running. [info | Dispatcher]: Node 291 (Op): running. [info | Dispatcher]: Node 292 (Op): running. [info | Dispatcher]: Node 293 (Op, Op>): running. [info | Dispatcher]: Node 294 (Op, Op>): running. [info | Dispatcher]: Node 295 (Op, Op>): running. [info | Dispatcher]: Node 296 (Op): running. [info | Dispatcher]: Node 297 (Op): running. [info | Dispatcher]: Node 298 (Op): running. [info | Dispatcher]: Node 299 (Op, Op, Op>): running. [info | Dispatcher]: Node 300 (Op, Op, Op>): running. [info | Dispatcher]: Node 301 (Op, Op>): running. [info | Dispatcher]: Node 302 (Op, Op>): running. [info | Dispatcher]: Node 303 (Op, Op>): running. [info | Dispatcher]: Node 304 (Op): running. [info | Dispatcher]: Node 305 (Op): running. [info | Dispatcher]: Node 306 (Op): running. [info | Dispatcher]: Node 307 (Op, Op>): running. [info | Dispatcher]: Node 308 (Op, Op>): running. [info | Dispatcher]: Node 309 (Op, Op>): running. [info | Dispatcher]: Node 310 (Op): running. [info | Dispatcher]: Node 311 (Op): running. [info | Dispatcher]: Node 312 (Op): running. [info | Dispatcher]: Node 313 (Op, Op, Op>): running. [info | Dispatcher]: Node 314 (Op, Op, Op>): running. [info | Dispatcher]: Node 315 (Op, Op>): running. [info | Dispatcher]: Node 316 (Op, Op>): running. [info | Dispatcher]: Node 317 (Op, Op>): running. [info | Dispatcher]: Node 318 (Op): running. [info | Dispatcher]: Node 319 (Op): running. [info | Dispatcher]: Node 320 (Op): running. [info | Dispatcher]: Node 321 (Op, Op>): running. [info | Dispatcher]: Node 322 (Op, Op>): running. [info | Dispatcher]: Node 323 (Op, Op>): running. [info | Dispatcher]: Node 324 (Op): running. [info | Dispatcher]: Node 325 (Op): running. [info | Dispatcher]: Node 326 (Op): running. [info | Dispatcher]: Node 327 (Op, Op, Op>): running. [info | Dispatcher]: Node 328 (Op, Op>): running. [info | Dispatcher]: Node 329 (Op): running. [info | Dispatcher]: Node 330 (Op, Op, Op>): running. [info | Dispatcher]: Node 331 (Op, Op, Op>): running. [info | Dispatcher]: Node 332 (Op, Op, Op>): running. [info | Dispatcher]: Node 333 (Op, Op>): running. [info | Dispatcher]: Node 334 (Op, Op>): running. [info | Dispatcher]: Node 335 (Op): running. [info | Dispatcher]: Node 336 (Op): running. [info | Dispatcher]: Node 337 (Op, Op>): running. [info | Dispatcher]: Node 338 (Op): running. [info | Dispatcher]: Node 339 (Op, Op, Op>): running. [info | Dispatcher]: Node 340 (Op, Op>): running. [info | Dispatcher]: Node 341 (Op): running. [info | Dispatcher]: Node 342 (Op, Op, Op>): running. [info | Dispatcher]: Node 343 (Op, Op, Op>): running. [info | Dispatcher]: Node 344 (Op, Op>): running. [info | Dispatcher]: Node 345 (Op, Op>): running. [info | Dispatcher]: Node 346 (Op): running. [info | Dispatcher]: Node 347 (Op): running. [info | Dispatcher]: Node 348 (Op, Op>): running. [info | Dispatcher]: Node 349 (Op, Op>): running. [info | Dispatcher]: Node 350 (Op, Op>): running. [info | Dispatcher]: Node 351 (Op): running. [info | Dispatcher]: Node 352 (Op): running. [info | Dispatcher]: Node 353 (Op): running. [info | Dispatcher]: Node 354 (Op, Op, Op>): running. [info | Dispatcher]: Node 355 (Op, Op, Op>): running. [info | Dispatcher]: Node 356 (Op, Op>): running. [info | Dispatcher]: Node 357 (Op): running. [info | Dispatcher]: Node 358 (Op, Op>): running. [info | Dispatcher]: Node 359 (Op): running. [info | Dispatcher]: Node 360 (Op, Op, Op>): running. [info | Dispatcher]: Node 361 (Op, Op, Op>): running. [info | Dispatcher]: Node 362 (Op, Op, Op>): running. [info | Dispatcher]: Node 363 (Op, Op, Op>): running. [info | Dispatcher]: Node 364 (Op, Op>): running. [info | Dispatcher]: Node 365 (Op): running. [info | Dispatcher]: Node 366 (Op, Op, Op>): running. [info | Dispatcher]: Node 367 (Op, Op>): running. [info | Dispatcher]: Node 368 (Op, Op>): running. [info | Dispatcher]: Node 369 (Op): running. [info | Dispatcher]: Node 370 (Op): running. [info | Dispatcher]: Node 371 (Op, Op, Op>): running. [info | Dispatcher]: Node 372 (Op, Op>): running. [info | Dispatcher]: Node 373 (Op, Op>): running. [info | Dispatcher]: Node 374 (Op, Op>): running. [info | Dispatcher]: Node 375 (Op): running. [info | Dispatcher]: Node 376 (Op): running. [info | Dispatcher]: Node 377 (Op): running. [info | Dispatcher]: Node 378 (Op, Op, Op>): running. [info | Dispatcher]: Node 379 (Op, Op>): running. [info | Dispatcher]: Node 380 (Op, Op>): running. [info | Dispatcher]: Node 381 (Op): running. [info | Dispatcher]: Node 382 (Op): running. [info | Dispatcher]: Node 383 (Op, Op, Op>): running. [info | Dispatcher]: Node 384 (Op, Op>): running. [info | Dispatcher]: Node 385 (Op, Op>): running. [info | Dispatcher]: Node 386 (Op): running. [info | Dispatcher]: Node 387 (Op): running. [info | Dispatcher]: Node 388 (Op, Op, Op>): running. [info | Dispatcher]: Node 389 (Op, Op>): running. [info | Dispatcher]: Node 390 (Op, Op>): running. [info | Dispatcher]: Node 391 (Op, Op>): running. [info | Dispatcher]: Node 392 (Op): running. [info | Dispatcher]: Node 393 (Op): running. [info | Dispatcher]: Node 394 (Op): running. [info | Dispatcher]: Node 395 (Op, Op, Op>): running. [info | Dispatcher]: Node 396 (Op, Op, Op>): running. [info | Dispatcher]: Node 397 (Op, Op>): running. [info | Dispatcher]: Node 398 (Op, Op>): running. [info | Dispatcher]: Node 399 (Op, Op>): running. [info | Dispatcher]: Node 400 (Op): running. [info | Dispatcher]: Node 401 (Op): running. [info | Dispatcher]: Node 402 (Op): running. [info | Dispatcher]: Node 403 (Op, Op, Op>): running. [info | Dispatcher]: Node 404 (Op, Op, Op>): running. [info | Dispatcher]: Node 405 (Op, Op>): running. [info | Dispatcher]: Node 406 (Op, Op>): running. [info | Dispatcher]: Node 407 (Op, Op>): running. [info | Dispatcher]: Node 408 (Op): running. [info | Dispatcher]: Node 409 (Op): running. [info | Dispatcher]: Node 410 (Op): running. [info | Dispatcher]: Node 411 (Op, Op>): running. [info | Dispatcher]: Node 412 (Op, Op>): running. [info | Dispatcher]: Node 413 (Op): running. [info | Dispatcher]: Node 414 (Op): running. [info | Dispatcher]: Node 415 (Op, Op, Op>): running. [info | Dispatcher]: Node 416 (Op, Op, Op>): running. [info | Dispatcher]: Node 417 (Op, Op>): running. [info | Dispatcher]: Node 418 (Op): running. [info | Dispatcher]: Node 419 (Op, Op, Op>): running. [info | Dispatcher]: Node 420 (Op, Op, Op>): running. [info | Dispatcher]: Node 421 (Op, Op>): running. [info | Dispatcher]: Node 422 (Op): running. [info | Dispatcher]: Node 423 (Op, Op, Op>): running. [info | Dispatcher]: Node 424 (Op, Op>): running. [info | Dispatcher]: Node 425 (Op): running. [info | Dispatcher]: Node 426 (Op, Op, Op>): running. [info | Dispatcher]: Node 427 (Op, Op, Op>): running. [info | Dispatcher]: Node 428 (Op, Op>): running. [info | Dispatcher]: Node 429 (Op): running. [info | Dispatcher]: Node 430 (Op, Op, Op>): running. [info | Dispatcher]: Node 431 (Op, Op, Op>): running. [info | Dispatcher]: Node 432 (Op, Op, Op>): running. [info | Dispatcher]: Node 433 (Op, Op>): running. [info | Dispatcher]: Node 434 (Op): running. [info | Dispatcher]: Node 435 (Op, Op, Op>): running. [info | Dispatcher]: Node 436 (Op, Op, Op>): running. [info | Dispatcher]: Node 437 (Op, Op, Op>): running. [info | Dispatcher]: Node 438 (Op, Op>): running. [info | Dispatcher]: Node 439 (Op, Op>): running. [info | Dispatcher]: Node 440 (Op, Op>): running. [info | Dispatcher]: Node 441 (Op): running. [info | Dispatcher]: Node 442 (Op): running. [info | Dispatcher]: Node 443 (Op): running. [info | Dispatcher]: Node 444 (Op, Op, Op>): running. [info | Dispatcher]: Node 445 (Op, Op, Op>): running. [info | Dispatcher]: Node 446 (Op, Op, Op>): running. [info | Dispatcher]: Node 447 (Op, Op, Op>): running. [info | Dispatcher]: Node 448 (Op, Op>): running. [info | Dispatcher]: Node 449 (Op): running. [info | Dispatcher]: Node 450 (Op, Op, Op>): running. [info | Dispatcher]: Node 451 (Op, Op, Op>): running. [info | Dispatcher]: Node 452 (Op, Op, Op>): running. [info | Dispatcher]: Node 453 (Op, Op, Op>): running. [info | Dispatcher]: Node 454 (Op, Op, Op>): running. [info | Dispatcher]: Node 455 (Op, Op, Op>): running. [info | Dispatcher]: Node 456 (Op, Op>): running. [info | Dispatcher]: Node 457 (Op): running. [info | Dispatcher]: Node 458 (Op, Op, Op>): running. [info | Dispatcher]: Node 459 (Op, Op, Op>): running. [info | Dispatcher]: Node 460 (Op, Op>): running. [info | Dispatcher]: Node 461 (Op): running. [info | Dispatcher]: Node 462 (Op, Op, Op>): running. [info | Dispatcher]: Node 463 (Op, Op, Op>): running. [info | Dispatcher]: Node 464 (Op, Op>): running. [info | Dispatcher]: Node 465 (Op): running. [info | Dispatcher]: Node 466 (Op, Op, Op>): running. [info | Dispatcher]: Node 467 (Op, Op, Op>): running. [info | Dispatcher]: Node 468 (Op, Op, Op>): running. [info | Dispatcher]: Node 469 (Op, Op, Op>): running. [info | Dispatcher]: Node 470 (Op, Op>): running. [info | Dispatcher]: Node 471 (Op): running. [info | Dispatcher]: Node 472 (Op, Op>): running. [info | Dispatcher]: Node 473 (Op): running. [info | Dispatcher]: Node 474 (Op, Op, Op>): running. [info | Dispatcher]: Node 475 (Op, Op, Op>): running. [info | Dispatcher]: Node 476 (Op, Op, Op>): running. [info | Dispatcher]: Node 477 (Op, Op, Op>): running. [info | Dispatcher]: Node 478 (Op, Op, Op>): running. [info | Dispatcher]: Node 479 (Op, Op, Op>): running. [info | Dispatcher]: Node 480 (Op, Op, Op>): running. [info | Dispatcher]: Node 481 (Op, Op, Op>): running. [info | Dispatcher]: Node 482 (Op, Op, Op>): running. [info | Dispatcher]: Node 483 (Op, Op, Op>): running. [info | Dispatcher]: Node 484 (Op, Op, Op>): running. [info | Dispatcher]: Node 485 (Op, Op>): running. [info | Dispatcher]: Node 486 (Op): running. [info | Dispatcher]: Node 487 (Op, Op, Op>): running. [info | Dispatcher]: Node 488 (Op, Op, Op>): running. [info | Dispatcher]: Node 489 (Op, Op, Op>): running. [info | Dispatcher]: Node 490 (Op, Op, Op>): running. [info | Dispatcher]: Node 491 (Op, Op, Op>): running. [info | Dispatcher]: Node 492 (Op, Op, Op>): running. [info | Dispatcher]: Node 493 (Op, Op, Op>): running. [info | Dispatcher]: Node 494 (Op, Op, Op>): running. [info | Dispatcher]: Node 495 (Op, Op, Op>): running. [info | Dispatcher]: Node 496 (Op, Op, Op>): running. [info | Dispatcher]: Node 497 (Op, Op, Op>): running. [info | Dispatcher]: Node 498 (Op, Op, Op>): running. [info | Dispatcher]: Node 499 (Op, Op, Op>): running. [info | Dispatcher]: Node 418 (Op): complete. [info | Dispatcher]: Node 319 (Op): complete. [info | Dispatcher]: Node 442 (Op): complete. [info | Dispatcher]: Node 304 (Op): complete. [info | Dispatcher]: Node 394 (Op): complete. [info | Dispatcher]: Node 229 (Op): complete. [info | Dispatcher]: Node 208 (Op): complete. [info | Dispatcher]: Node 325 (Op): complete. [info | Dispatcher]: Node 400 (Op): complete. [info | Dispatcher]: Node 457 (Op): complete. [info | Dispatcher]: Node 244 (Op): complete. [info | Dispatcher]: Node 292 (Op): complete. [info | Dispatcher]: Node 310 (Op): complete. [info | Dispatcher]: Node 238 (Op): complete. [info | Dispatcher]: Node 382 (Op): complete. [info | Dispatcher]: Node 298 (Op): complete. [info | Dispatcher]: Node 217 (Op): complete. [info | Dispatcher]: Node 262 (Op): complete. [info | Dispatcher]: Node 211 (Op): complete. [info | Dispatcher]: Node 370 (Op): complete. [info | Dispatcher]: Node 277 (Op): complete. [info | Dispatcher]: Node 376 (Op): complete. [info | Dispatcher]: Node 283 (Op): complete. [info | Dispatcher]: Node 352 (Op): complete. [info | Dispatcher]: Node 271 (Op): complete. [info | Dispatcher]: Node 346 (Op): complete. [info | Dispatcher]: Node 253 (Op): complete. [info | Dispatcher]: Node 259 (Op): complete. [info | Dispatcher]: Node 409 (Op): complete. [info | Dispatcher]: Node 223 (Op): complete. [info | Dispatcher]: Node 429 (Op): complete. [info | Dispatcher]: Node 375 (Op): complete. [info | Dispatcher]: Node 270 (Op): complete. [info | Dispatcher]: Node 282 (Op): complete. [info | Dispatcher]: Node 357 (Op): complete. [info | Dispatcher]: Node 276 (Op): complete. [info | Dispatcher]: Node 387 (Op): complete. [info | Dispatcher]: Node 393 (Op): complete. [info | Dispatcher]: Node 336 (Op): complete. [info | Dispatcher]: Node 216 (Op): complete. [info | Dispatcher]: Node 255 (Op): complete. [info | Dispatcher]: Node 243 (Op): complete. [info | Dispatcher]: Node 414 (Op): complete. [info | Dispatcher]: Node 312 (Op): complete. [info | Dispatcher]: Node 402 (Op): complete. [info | Dispatcher]: Node 486 (Op): complete. [info | Dispatcher]: Node 237 (Op): complete. [info | Dispatcher]: Node 351 (Op): complete. [info | Dispatcher]: Node 381 (Op): complete. [info | Dispatcher]: Node 297 (Op): complete. [info | Dispatcher]: Node 291 (Op): complete. [info | Dispatcher]: Node 231 (Op): complete. [info | Dispatcher]: Node 369 (Op): complete. [info | Dispatcher]: Node 408 (Op): complete. [info | Dispatcher]: Node 306 (Op): complete. [info | Dispatcher]: Node 225 (Op): complete. [info | Dispatcher]: Node 324 (Op): complete. [info | Dispatcher]: Node 441 (Op): complete. [info | Dispatcher]: Node 210 (Op): complete. [info | Dispatcher]: Node 465 (Op): complete. [info | Dispatcher]: Node 249 (Op): complete. [info | Dispatcher]: Node 318 (Op): complete. [info | Dispatcher]: Node 471 (Op): complete. From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: peer 36 has not connected to 37 From worker 37: Stacktrace: From worker 37: [1] (::Distributed.var"#exec_conn_func##2#exec_conn_func##3"{ErrorException})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func(w::Distributed.Worker) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] (::Distributed.var"#check_worker_state##0#check_worker_state##1"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:166 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] error From worker 37: @ ./error.jl:44 From worker 37: [2] wait_for_conn From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:195 From worker 37: [3] #exec_conn_func##0 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:183 From worker 37: [4] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [5] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [6] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [7] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [8] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 [info | Dispatcher]: Node 365 (Op): complete. [info | Dispatcher]: Node 290 (Op): complete. [info | Dispatcher]: Node 401 (Op): complete. [info | Dispatcher]: Node 311 (Op): complete. [info | Dispatcher]: Node 449 (Op): complete. [info | Dispatcher]: Node 263 (Op): complete. [info | Dispatcher]: Node 224 (Op): complete. [info | Dispatcher]: Node 422 (Op): complete. [info | Dispatcher]: Node 461 (Op): complete. [info | Dispatcher]: Node 215 (Op): complete. [info | Dispatcher]: Node 410 (Op): complete. [info | Dispatcher]: Node 359 (Op): complete. [info | Dispatcher]: Node 275 (Op): complete. [info | Dispatcher]: Node 230 (Op): complete. [info | Dispatcher]: Node 347 (Op): complete. [info | Dispatcher]: Node 386 (Op): complete. [info | Dispatcher]: Node 245 (Op): complete. [info | Dispatcher]: Node 335 (Op): complete. [info | Dispatcher]: Node 413 (Op): complete. [info | Dispatcher]: Node 305 (Op): complete. [info | Dispatcher]: Node 296 (Op): complete. [info | Dispatcher]: Node 284 (Op): complete. [info | Dispatcher]: Node 269 (Op): complete. [info | Dispatcher]: Node 377 (Op): complete. [info | Dispatcher]: Node 329 (Op): complete. [info | Dispatcher]: Node 392 (Op): complete. [info | Dispatcher]: Node 353 (Op): complete. [info | Dispatcher]: Node 254 (Op): complete. [info | Dispatcher]: Node 341 (Op): complete. [info | Dispatcher]: Node 239 (Op): complete. [info | Dispatcher]: Node 473 (Op): complete. [info | Dispatcher]: Node 443 (Op): complete. [info | Dispatcher]: Node 434 (Op): complete. [info | Dispatcher]: Node 320 (Op): complete. [info | Dispatcher]: Node 326 (Op): complete. [info | Dispatcher]: Node 425 (Op): complete. [info | Dispatcher]: Node 338 (Op): complete. [info | Dispatcher]: Node 209 (Op): complete. From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 [info | Dispatcher]: Node 222 (Op, Op>): complete. From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: UNHANDLED TASK ERROR: On worker 1: From worker 37: On worker 38: From worker 37: peer 37 has not connected to 38 From worker 37: Stacktrace: From worker 37: [1] #exec_conn_func##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 37: [2] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 37: [3] exec_conn_func From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 37: [4] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [5] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [6] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] #remotecall_fetch#109 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] #check_worker_state##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 37: [5] #handle_msg##4 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: [6] run_work_thunk From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 37: [7] #handle_msg##2 From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 37: Stacktrace: From worker 37: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 37: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 37: [3] remotecall_fetch From worker 37: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 37: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 37: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 [info | Dispatcher]: Node 260 (Op, Op>): complete. [info | Dispatcher]: Node 374 (Op, Op>): complete. [info | Dispatcher]: Node 293 (Op, Op>): complete. [info | Dispatcher]: Node 323 (Op, Op>): complete. [info | Dispatcher]: Node 266 (Op, Op>): complete. [info | Dispatcher]: Node 213 (Op, Op>): complete. [info | Dispatcher]: Node 212 (Op, Op>): complete. [info | Dispatcher]: Node 389 (Op, Op>): complete. [info | Dispatcher]: Node 207 (Op, Op>): complete. [info | Dispatcher]: Node 251 (Op, Op>): complete. [info | Dispatcher]: Node 252 (Op, Op>): complete. [info | Dispatcher]: Node 261 (Op, Op>): complete. [info | Dispatcher]: Node 281 (Op, Op>): complete. [info | Dispatcher]: Node 440 (Op, Op>): complete. [info | Dispatcher]: Node 384 (Op, Op>): complete. [info | Dispatcher]: Node 240 (Op, Op>): complete. [info | Dispatcher]: Node 428 (Op, Op>): complete. [info | Dispatcher]: Node 303 (Op, Op>): complete. [info | Dispatcher]: Node 242 (Op, Op>): complete. [info | Dispatcher]: Node 315 (Op, Op>): complete. [info | Dispatcher]: Node 206 (Op, Op>): complete. [info | Dispatcher]: Node 417 (Op, Op>): complete. [info | Dispatcher]: Node 248 (Op, Op>): complete. [info | Dispatcher]: Node 287 (Op, Op>): complete. [info | Dispatcher]: Node 356 (Op, Op>): complete. [info | Dispatcher]: Node 348 (Op, Op>): complete. [info | Dispatcher]: Node 227 (Op, Op>): complete. [info | Dispatcher]: Node 221 (Op, Op>): complete. [info | Dispatcher]: Node 267 (Op, Op>): complete. [info | Dispatcher]: Node 279 (Op, Op>): complete. [info | Dispatcher]: Node 405 (Op, Op>): complete. [info | Dispatcher]: Node 228 (Op, Op>): complete. [info | Dispatcher]: Node 273 (Op, Op>): complete. [info | Dispatcher]: Node 234 (Op, Op>): complete. [info | Dispatcher]: Node 294 (Op, Op>): complete. [info | Dispatcher]: Node 317 (Op, Op>): complete. [info | Dispatcher]: Node 407 (Op, Op>): complete. [info | Dispatcher]: Node 302 (Op, Op>): complete. [info | Dispatcher]: Node 344 (Op, Op>): complete. [info | Dispatcher]: Node 464 (Op, Op>): complete. [info | Dispatcher]: Node 485 (Op, Op>): complete. [info | Dispatcher]: Node 272 (Op, Op>): complete. [info | Dispatcher]: Node 398 (Op, Op>): complete. [info | Dispatcher]: Node 380 (Op, Op>): complete. [info | Dispatcher]: Node 350 (Op, Op>): complete. [info | Dispatcher]: Node 308 (Op, Op>): complete. [info | Dispatcher]: Node 467 (Op, Op, Op>): complete. [info | Dispatcher]: Node 236 (Op, Op>): complete. [info | Dispatcher]: Node 456 (Op, Op>): complete. [info | Dispatcher]: Node 368 (Op, Op>): complete. [info | Dispatcher]: Node 288 (Op, Op>): complete. [info | Dispatcher]: Node 411 (Op, Op>): complete. [info | Dispatcher]: Node 321 (Op, Op>): complete. [info | Dispatcher]: Node 372 (Op, Op>): complete. [info | Dispatcher]: Node 438 (Op, Op>): complete. [info | Dispatcher]: Node 309 (Op, Op>): complete. [info | Dispatcher]: Node 345 (Op, Op>): complete. [info | Dispatcher]: Node 258 (Op, Op>): complete. [info | Dispatcher]: Node 470 (Op, Op>): complete. [info | Dispatcher]: Node 360 (Op, Op, Op>): complete. [info | Dispatcher]: Node 333 (Op, Op>): complete. [info | Dispatcher]: Node 399 (Op, Op>): complete. [info | Dispatcher]: Node 390 (Op, Op>): complete. [info | Dispatcher]: Node 416 (Op, Op, Op>): complete. [info | Dispatcher]: Node 435 (Op, Op, Op>): complete. [info | Dispatcher]: Node 62 (Op, Op>): complete. [info | Dispatcher]: Node 462 (Op, Op, Op>): complete. From worker 36: UNHANDLED TASK ERROR: On worker 1:[info | Dispatcher]: Node 301 (Op, Op>): complete. [info | Dispatcher]: Node 460 (Op, Op>): complete. [info | Dispatcher]: Node 412 (Op, Op>): complete. [info | Dispatcher]: Node 295 (Op, Op>): complete. [info | Dispatcher]: Node 373 (Op, Op>): complete. [info | Dispatcher]: Node 340 (Op, Op>): complete. [info | Dispatcher]: Node 433 (Op, Op>): complete. [info | Dispatcher]: Node 421 (Op, Op>): complete. [info | Dispatcher]: Node 490 (Op, Op, Op>): complete. [info | Dispatcher]: Node 214 (Op, Op>): complete. [info | Dispatcher]: Node 391 (Op, Op>): complete. [info | Dispatcher]: Node 463 (Op, Op, Op>): complete. [info | Dispatcher]: Node 203 (Op, Op, Op>): complete. [info | Dispatcher]: Node 247 (Op, Op, Op>): complete. [info | Dispatcher]: Node 274 (Op, Op>): complete. [info | Dispatcher]: Node 487 (Op, Op, Op>): complete. [info | Dispatcher]: Node 334 (Op, Op>): complete. [info | Dispatcher]: Node 499 (Op, Op, Op>): complete. [info | Dispatcher]: Node 300 (Op, Op, Op>): complete. [info | Dispatcher]: Node 454 (Op, Op, Op>): complete. [info | Dispatcher]: Node 424 (Op, Op>): complete. [info | Dispatcher]: Node 472 (Op, Op>): complete. [info | Dispatcher]: Node 432 (Op, Op, Op>): complete. [info | Dispatcher]: Node 144 (Op, Op>): complete. [info | Dispatcher]: Node 483 (Op, Op, Op>): complete. [info | Dispatcher]: Node 371 (Op, Op, Op>): complete. [info | Dispatcher]: Node 477 (Op, Op, Op>): complete. [info | Dispatcher]: Node 458 (Op, Op, Op>): complete. [info | Dispatcher]: Node 469 (Op, Op, Op>): complete. [info | Dispatcher]: Node 343 (Op, Op, Op>): complete. [info | Dispatcher]: Node 388 (Op, Op, Op>): complete. [info | Dispatcher]: Node 241 (Op, Op>): complete. [info | Dispatcher]: Node 478 (Op, Op, Op>): complete. [info | Dispatcher]: Node 307 (Op, Op>): complete. [info | Dispatcher]: Node 379 (Op, Op>): complete. [info | Dispatcher]: Node 226 (Op, Op>): complete. [info | Dispatcher]: Node 285 (Op, Op, Op>): complete. [info | Dispatcher]: Node 57 (Op, Op>): complete. [info | Dispatcher]: Node 280 (Op, Op>): complete. [info | Dispatcher]: Node 103 (Op, Op>): complete. [info | Dispatcher]: Node 178 (Op, Op>): complete. [info | Dispatcher]: Node 332 (Op, Op, Op>): complete. [info | Dispatcher]: Node 427 (Op, Op, Op>): complete. [info | Dispatcher]: Node 5 (Op, Op>): complete. [info | Dispatcher]: Node 264 (Op, Op, Op>): complete. [info | Dispatcher]: Node 479 (Op, Op, Op>): complete. [info | Dispatcher]: Node 133 (Op, Op>): complete. [info | Dispatcher]: Node 322 (Op, Op>): complete. [info | Dispatcher]: Node 232 (Op, Op, Op>): complete. [info | Dispatcher]: Node 495 (Op, Op, Op>): complete. [info | Dispatcher]: Node 3 (Op, Op>): complete. [info | Dispatcher]: Node 498 (Op, Op, Op>): complete. [info | Dispatcher]: Node 468 (Op, Op, Op>): complete. [info | Dispatcher]: Node 299 (Op, Op, Op>): complete. [info | Dispatcher]: Node 164 (Op, Op>): complete. [info | Dispatcher]: Node 143 (Op, Op>): complete. [info | Dispatcher]: Node 113 (Op, Op>): complete. [info | Dispatcher]: Node 361 (Op, Op, Op>): complete. [info | Dispatcher]: Node 459 (Op, Op, Op>): complete. [info | Dispatcher]: Node 235 (Op, Op>): complete. [info | Dispatcher]: Node 497 (Op, Op, Op>): complete. [info | Dispatcher]: Node 328 (Op, Op>): complete. [info | Dispatcher]: Node 355 (Op, Op, Op>): complete. [info | Dispatcher]: Node 430 (Op, Op, Op>): complete. [info | Dispatcher]: Node 101 (Op, Op>): complete. [info | Dispatcher]: Node 175 (Op, Op>): complete. [info | Dispatcher]: Node 120 (Op, Op>): complete. [info | Dispatcher]: Node 67 (Op, Op>): complete. [info | Dispatcher]: Node 96 (Op, Op>): complete. [info | Dispatcher]: Node 184 (Op, Op>): complete. [info | Dispatcher]: Node 423 (Op, Op, Op>): complete. [info | Dispatcher]: Node 488 (Op, Op, Op>): complete. [info | Dispatcher]: Node 193 (Op, Op>): complete. [info | Dispatcher]: Node 122 (Op, Op>): complete. [info | Dispatcher]: Node 337 (Op, Op>): complete. [info | Dispatcher]: Node 364 (Op, Op>): complete. [info | Dispatcher]: Node 31 (Op, Op>): complete. [info | Dispatcher]: Node 81 (Op, Op>): complete. [info | Dispatcher]: Node 138 (Op, Op>): complete. [info | Dispatcher]: Node 71 (Op, Op>): complete. [info | Dispatcher]: Node 139 (Op, Op>): complete. [info | Dispatcher]: Node 268 (Op, Op>): complete. [info | Dispatcher]: Node 397 (Op, Op>): complete. [info | Dispatcher]: Node 349 (Op, Op>): complete. [info | Dispatcher]: Node 426 (Op, Op, Op>): complete. [info | Dispatcher]: Node 250 (Op, Op>): complete. [info | Dispatcher]: Node 445 (Op, Op, Op>): complete. [info | Dispatcher]: Node 166 (Op, Op>): complete. [info | Dispatcher]: Node 13 (Op, Op>): complete. [info | Dispatcher]: Node 17 (Op, Op>): complete. [info | Dispatcher]: Node 48 (Op, Op>): complete. [info | Dispatcher]: Node 116 (Op, Op>): complete. [info | Dispatcher]: Node 436 (Op, Op, Op>): complete. [info | Dispatcher]: Node 494 (Op, Op, Op>): complete. [info | Dispatcher]: Node 439 (Op, Op>): complete. [info | Dispatcher]: Node 327 (Op, Op, Op>): complete. [info | Dispatcher]: Node 169 (Op, Op>): complete. [info | Dispatcher]: Node 342 (Op, Op, Op>): complete. [info | Dispatcher]: Node 385 (Op, Op>): complete. [info | Dispatcher]: Node 218 (Op, Op, Op>): complete. [info | Dispatcher]: Node 257 (Op, Op, Op>): complete. [info | Dispatcher]: Node 140 (Op, Op>): complete. [info | Dispatcher]: Node 265 (Op, Op, Op>): complete. [info | Dispatcher]: Node 395 (Op, Op, Op>): complete. [info | Dispatcher]: Node 313 (Op, Op, Op>): complete. [info | Dispatcher]: Node 233 (Op, Op, Op>): complete. [info | Dispatcher]: Node 145 (Op, Op>): complete. [info | Dispatcher]: Node 437 (Op, Op, Op>): complete. [info | Dispatcher]: Node 466 (Op, Op, Op>): complete. [info | Dispatcher]: Node 491 (Op, Op, Op>): complete. [info | Dispatcher]: Node 278 (Op, Op, Op>): complete. [info | Dispatcher]: Node 142 (Op, Op>): complete. [info | Dispatcher]: Node 196 (Op, Op>): complete. [info | Dispatcher]: Node 58 (Op, Op>): complete. [info | Dispatcher]: Node 111 (Op, Op>): complete. [info | Dispatcher]: Node 105 (Op, Op>): complete. [info | Dispatcher]: Node 420 (Op, Op, Op>): complete. [info | Dispatcher]: Node 40 (Op, Op>): complete. [info | Dispatcher]: Node 496 (Op, Op, Op>): complete. [info | Dispatcher]: Node 130 (Op, Op>): complete. [info | Dispatcher]: Node 406 (Op, Op>): complete. [info | Dispatcher]: Node 362 (Op, Op, Op>): complete. [info | Dispatcher]: Node 34 (Op, Op>): complete. [info | Dispatcher]: Node 21 (Op, Op>): complete. [info | Dispatcher]: Node 161 (Op, Op>): complete. [info | Dispatcher]: Node 72 (Op, Op>): complete. [info | Dispatcher]: Node 492 (Op, Op, Op>): complete. [info | Dispatcher]: Node 195 (Op, Op>): complete. [info | Dispatcher]: Node 117 (Op, Op>): complete. [info | Dispatcher]: Node 22 (Op, Op>): complete. [info | Dispatcher]: Node 55 (Op, Op>): complete. [info | Dispatcher]: Node 450 (Op, Op, Op>): complete. [info | Dispatcher]: Node 358 (Op, Op>): complete. [info | Dispatcher]: Node 205 (Op, Op>): complete. [info | Dispatcher]: Node 187 (Op, Op>): complete. [info | Dispatcher]: Node 92 (Op, Op>): complete. [info | Dispatcher]: Node 363 (Op, Op, Op>): complete. [info | Dispatcher]: Node 481 (Op, Op, Op>): complete. [info | Dispatcher]: Node 171 (Op, Op>): complete. [info | Dispatcher]: Node 8 (Op, Op>): complete. [info | Dispatcher]: Node 452 (Op, Op, Op>): complete. [info | Dispatcher]: Node 46 (Op, Op>): complete. [info | Dispatcher]: Node 23 (Op, Op>): complete. [info | Dispatcher]: Node 69 (Op, Op>): complete. [info | Dispatcher]: Node 76 (Op, Op>): complete. [info | Dispatcher]: Node 191 (Op, Op>): complete. [info | Dispatcher]: Node 79 (Op, Op>): complete. [info | Dispatcher]: Node 484 (Op, Op, Op>): complete. [info | Dispatcher]: Node 10 (Op, Op>): complete. [info | Dispatcher]: Node 115 (Op, Op>): complete. [info | Dispatcher]: Node 474 (Op, Op, Op>): complete. [info | Dispatcher]: Node 80 (Op, Op>): complete. [info | Dispatcher]: Node 163 (Op, Op>): complete. [info | Dispatcher]: Node 50 (Op, Op>): complete. [info | Dispatcher]: Node 415 (Op, Op, Op>): complete. [info | Dispatcher]: Node 118 (Op, Op>): complete. [info | Dispatcher]: Node 107 (Op, Op>): complete. [info | Dispatcher]: Node 155 (Op, Op>): complete. [info | Dispatcher]: Node 200 (Op, Op>): complete. [info | Dispatcher]: Node 18 (Op, Op>): complete. [info | Dispatcher]: Node 444 (Op, Op, Op>): complete. [info | Dispatcher]: Node 11 (Op, Op>): complete. [info | Dispatcher]: Node 137 (Op, Op>): complete. [info | Dispatcher]: Node 403 (Op, Op, Op>): complete. [info | Dispatcher]: Node 52 (Op, Op>): complete. [info | Dispatcher]: Node 383 (Op, Op, Op>): complete. [info | Dispatcher]: Node 316 (Op, Op>): complete. [info | Dispatcher]: Node 181 (Op, Op>): complete. [info | Dispatcher]: Node 158 (Op, Op>): complete. [info | Dispatcher]: Node 65 (Op, Op>): complete. [info | Dispatcher]: Node 149 (Op, Op>): complete. [info | Dispatcher]: Node 396 (Op, Op, Op>): complete. [info | Dispatcher]: Node 9 (Op, Op>): complete. [info | Dispatcher]: Node 354 (Op, Op, Op>): complete. [info | Dispatcher]: Node 448 (Op, Op>): complete. [info | Dispatcher]: Node 367 (Op, Op>): complete. [info | Dispatcher]: Node 220 (Op, Op>): complete. [info | Dispatcher]: Node 148 (Op, Op>): complete. [info | Dispatcher]: Node 136 (Op, Op>): complete. [info | Dispatcher]: Node 289 (Op, Op>): complete. [info | Dispatcher]: Node 331 (Op, Op, Op>): complete. [info | Dispatcher]: Node 174 (Op, Op>): complete. [info | Dispatcher]: Node 54 (Op, Op>): complete. [info | Dispatcher]: Node 204 (Op, Op, Op>): complete. [info | Dispatcher]: Node 24 (Op, Op>): complete. [info | Dispatcher]: Node 108 (Op, Op>): complete. [info | Dispatcher]: Node 162 (Op, Op>): complete. [info | Dispatcher]: Node 152 (Op, Op>): complete. [info | Dispatcher]: Node 170 (Op, Op>): complete. [info | Dispatcher]: Node 104 (Op, Op>): complete. [info | Dispatcher]: Node 219 (Op, Op, Op>): complete. [info | Dispatcher]: Node 112 (Op, Op>): complete. [info | Dispatcher]: Node 60 (Op, Op>): complete. [info | Dispatcher]: Node 14 (Op, Op>): complete. [info | Dispatcher]: Node 451 (Op, Op, Op>): complete. [info | Dispatcher]: Node 404 (Op, Op, Op>): complete. [info | Dispatcher]: Node 134 (Op, Op>): complete. [info | Dispatcher]: Node 419 (Op, Op, Op>): complete. [info | Dispatcher]: Node 160 (Op, Op>): complete. [info | Dispatcher]: Node 129 (Op, Op>): complete. [info | Dispatcher]: Node 183 (Op, Op>): complete. [info | Dispatcher]: Node 32 (Op, Op>): complete. [info | Dispatcher]: Node 15 (Op, Op>): complete. [info | Dispatcher]: Node 27 (Op, Op>): complete. [info | Dispatcher]: Node 51 (Op, Op>): complete. [info | Dispatcher]: Node 141 (Op, Op>): complete. [info | Dispatcher]: Node 476 (Op, Op, Op>): complete. [info | Dispatcher]: Node 179 (Op, Op>): complete. [info | Dispatcher]: Node 106 (Op, Op>): complete. [info | Dispatcher]: Node 36 (Op, Op>): complete. [info | Dispatcher]: Node 95 (Op, Op>): complete. [info | Dispatcher]: Node 30 (Op, Op>): complete. [info | Dispatcher]: Node 159 (Op, Op>): complete. [info | Dispatcher]: Node 53 (Op, Op>): complete. [info | Dispatcher]: Node 43 (Op, Op>): complete. [info | Dispatcher]: Node 153 (Op, Op>): complete. [info | Dispatcher]: Node 246 (Op, Op, Op>): complete. [info | Dispatcher]: Node 98 (Op, Op>): complete. [info | Dispatcher]: Node 59 (Op, Op>): complete. [info | Dispatcher]: Node 44 (Op, Op>): complete. [info | Dispatcher]: Node 447 (Op, Op, Op>): complete. [info | Dispatcher]: Node 177 (Op, Op>): complete. [info | Dispatcher]: Node 330 (Op, Op, Op>): complete. [info | Dispatcher]: Node 366 (Op, Op, Op>): complete. [info | Dispatcher]: Node 93 (Op, Op>): complete. [info | Dispatcher]: Node 431 (Op, Op, Op>): complete. [info | Dispatcher]: Node 127 (Op, Op>): complete. [info | Dispatcher]: Node 453 (Op, Op, Op>): complete. [info | Dispatcher]: Node 114 (Op, Op>): complete. [info | Dispatcher]: Node 168 (Op, Op>): complete. [info | Dispatcher]: Node 82 (Op, Op>): complete. [info | Dispatcher]: Node 41 (Op, Op>): complete. [info | Dispatcher]: Node 20 (Op, Op>): complete. [info | Dispatcher]: Node 6 (Op, Op>): complete. [info | Dispatcher]: Node 45 (Op, Op>): complete. [info | Dispatcher]: Node 446 (Op, Op, Op>): complete. [info | Dispatcher]: Node 482 (Op, Op, Op>): complete. [info | Dispatcher]: Node 83 (Op, Op>): complete. [info | Dispatcher]: Node 286 (Op, Op, Op>): complete. [info | Dispatcher]: Node 202 (Op, Op>): complete. [info | Dispatcher]: Node 480 (Op, Op, Op>): complete. [info | Dispatcher]: Node 4 (Op, Op>): complete. [info | Dispatcher]: Node 131 (Op, Op>): complete. [info | Dispatcher]: Node 75 (Op, Op>): complete. [info | Dispatcher]: Node 25 (Op, Op>): complete. [info | Dispatcher]: Node 378 (Op, Op, Op>): complete. [info | Dispatcher]: Node 156 (Op, Op>): complete. [info | Dispatcher]: Node 102 (Op, Op>): complete. [info | Dispatcher]: Node 151 (Op, Op>): complete. [info | Dispatcher]: Node 121 (Op, Op>): complete. [info | Dispatcher]: Node 128 (Op, Op>): complete. [info | Dispatcher]: Node 47 (Op, Op>): complete. [info | Dispatcher]: Node 89 (Op, Op>): complete. [info | Dispatcher]: Node 199 (Op, Op>): complete. [info | Dispatcher]: Node 186 (Op, Op>): complete. [info | Dispatcher]: Node 167 (Op, Op>): complete. [info | Dispatcher]: Node 110 (Op, Op>): complete. [info | Dispatcher]: Node 91 (Op, Op>): complete. [info | Dispatcher]: Node 493 (Op, Op, Op>): complete. [info | Dispatcher]: Node 189 (Op, Op>): complete. [info | Dispatcher]: Node 147 (Op, Op>): complete. [info | Dispatcher]: Node 78 (Op, Op>): complete. [info | Dispatcher]: Node 173 (Op, Op>): complete. [info | Dispatcher]: Node 176 (Op, Op>): complete. [info | Dispatcher]: Node 201 (Op, Op>): complete. [info | Dispatcher]: Node 37 (Op, Op>): complete. [info | Dispatcher]: Node 61 (Op, Op>): complete. [info | Dispatcher]: Node 256 (Op, Op, Op>): complete. [info | Dispatcher]: Node 489 (Op, Op, Op>): complete. [info | Dispatcher]: Node 39 (Op, Op>): complete. [info | Dispatcher]: Node 314 (Op, Op, Op>): complete. [info | Dispatcher]: Node 29 (Op, Op>): complete. [info | Dispatcher]: Node 126 (Op, Op>): complete. [info | Dispatcher]: Node 150 (Op, Op>): complete. [info | Dispatcher]: Node 86 (Op, Op>): complete. [info | Dispatcher]: Node 475 (Op, Op, Op>): complete. [info | Dispatcher]: Node 12 (Op, Op>): complete. [info | Dispatcher]: Node 35 (Op, Op>): complete. [info | Dispatcher]: Node 182 (Op, Op>): complete. [info | Dispatcher]: Node 77 (Op, Op>): complete. [info | Dispatcher]: Node 135 (Op, Op>): complete. [info | Dispatcher]: Node 73 (Op, Op>): complete. [info | Dispatcher]: Node 172 (Op, Op>): complete. [info | Dispatcher]: Node 119 (Op, Op>): complete. [info | Dispatcher]: Node 87 (Op, Op>): complete. [info | Dispatcher]: Node 33 (Op, Op>): complete. [info | Dispatcher]: Node 185 (Op, Op>): complete. [info | Dispatcher]: Node 124 (Op, Op>): complete. [info | Dispatcher]: Node 49 (Op, Op>): complete. [info | Dispatcher]: Node 16 (Op, Op>): complete. [info | Dispatcher]: Node 26 (Op, Op>): complete. [info | Dispatcher]: Node 42 (Op, Op>): complete. [info | Dispatcher]: Node 7 (Op, Op>): complete. [info | Dispatcher]: Node 339 (Op, Op, Op>): complete. [info | Dispatcher]: Node 90 (Op, Op>): complete. [info | Dispatcher]: Node 63 (Op, Op>): complete. [info | Dispatcher]: Node 38 (Op, Op>): complete. [info | Dispatcher]: Node 74 (Op, Op>): complete. [info | Dispatcher]: Node 100 (Op, Op>): complete. [info | Dispatcher]: Node 88 (Op, Op>): complete. [info | Dispatcher]: Node 188 (Op, Op>): complete. [info | Dispatcher]: Node 99 (Op, Op>): complete. [info | Dispatcher]: Node 66 (Op, Op>): complete. [info | Dispatcher]: Node 125 (Op, Op>): complete. [info | Dispatcher]: Node 180 (Op, Op>): complete. [info | Dispatcher]: Node 165 (Op, Op>): complete. [info | Dispatcher]: Node 109 (Op, Op>): complete. [info | Dispatcher]: Node 157 (Op, Op>): complete. [info | Dispatcher]: Node 123 (Op, Op>): complete. [info | Dispatcher]: Node 190 (Op, Op>): complete. [info | Dispatcher]: Node 154 (Op, Op>): complete. [info | Dispatcher]: Node 198 (Op, Op>): complete. [info | Dispatcher]: Node 197 (Op, Op>): complete. [info | Dispatcher]: Node 194 (Op, Op>): complete. [info | Dispatcher]: Node 455 (Op, Op, Op>): complete. [info | Dispatcher]: Node 28 (Op, Op>): complete. [info | Dispatcher]: Node 85 (Op, Op>): complete. [info | Dispatcher]: Node 19 (Op, Op>): complete. [info | Dispatcher]: Node 97 (Op, Op>): complete. [info | Dispatcher]: Node 132 (Op, Op>): complete. [info | Dispatcher]: Node 64 (Op, Op>): complete. [info | Dispatcher]: Node 94 (Op, Op>): complete. [info | Dispatcher]: Node 56 (Op, Op>): complete. [info | Dispatcher]: Node 192 (Op, Op>): complete. [info | Dispatcher]: Node 68 (Op, Op>): complete. [info | Dispatcher]: Node 146 (Op, Op>): complete. [info | Dispatcher]: Node 84 (Op, Op>): complete. [info | Dispatcher]: Node 70 (Op, Op>): complete. [info | Dispatcher]: Node 2 (CollectNode<200 Ops>): complete. [info | Dispatcher]: Node 1 (Op>): complete. From worker 36: On worker 37: [info | Dispatcher]: All 499 nodes executed. From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] error From worker 36: @ ./error.jl:44 From worker 36: [2] wait_for_conn From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:195 From worker 36: [3] #exec_conn_func##0 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:183 From worker 36: [4] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [5] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [6] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [7] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [8] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: UNHANDLED TASK ERROR: On worker 1: From worker 36: On worker 37: From worker 36: peer 36 has not connected to 37 From worker 36: Stacktrace: From worker 36: [1] #exec_conn_func##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:186 From worker 36: [2] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:184 From worker 36: [3] exec_conn_func From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:178 From worker 36: [4] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [5] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [6] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] #remotecall_fetch#109 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] #check_worker_state##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 From worker 36: [5] #handle_msg##4 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: [6] run_work_thunk From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:70 From worker 36: [7] #handle_msg##2 From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/process_messages.jl:287 From worker 36: Stacktrace: From worker 36: [1] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}; kwargs::@Kwargs{}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:465 From worker 36: [2] remotecall_fetch(::Function, ::Distributed.Worker, ::Int64, ::Vararg{Int64}) From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:454 From worker 36: [3] remotecall_fetch From worker 36: @ /opt/julia/share/julia/stdlib/v1.13/Distributed/src/remotecall.jl:492 [inlined] From worker 36: [4] (::Distributed.var"#check_worker_state##2#check_worker_state##3"{Distributed.Worker})() From worker 36: @ Distributed /opt/julia/share/julia/stdlib/v1.13/Distributed/src/cluster.jl:169 ┌ Warning: `sort(d::Dict; args...)` is deprecated, use `sort!(OrderedDict(d); args...)` instead. │ caller = show at nodes.jl:704 [inlined] └ @ Core ~/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:704 ┌ Warning: `sort(d::Dict; args...)` is deprecated, use `sort!(OrderedDict(d); args...)` instead. │ caller = show at nodes.jl:704 [inlined] └ @ Core ~/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:704 Test Summary: | Pass Fail Total Time Dispatcher | 268 2 270 32m30.7s Macros | 40 40 4.1s Executors | 212 2 214 24m18.8s Async | 32 32 9.5s Parallel - 1 process | 10 10 2.5s Parallel - 2 process | 10 10 1m05.7s Parallel - 3 process | 10 10 1m25.9s Error Handling | 150 2 152 21m35.2s Async - Application Errors | 9 1 10 11.9s Parallel - Application Errors | 9 1 10 1m00.5s 1 procs removed (delay 0.1) | 11 11 1m56.1s 1 procs removed (delay 0.2) | 11 11 1m58.9s 1 procs removed (delay 0.3) | 11 11 2m02.5s 1 procs removed (delay 0.4) | 11 11 1m49.7s 1 procs removed (delay 0.5) | 11 11 1m36.7s 1 procs removed (delay 0.6) | 11 11 1m30.1s 2 procs removed (delay 0.1) | 11 11 1m24.2s 2 procs removed (delay 0.2) | 11 11 1m35.2s 2 procs removed (delay 0.3) | 11 11 1m36.1s 2 procs removed (delay 0.4) | 11 11 1m34.0s 2 procs removed (delay 0.5) | 11 11 1m32.0s 2 procs removed (delay 0.6) | 11 11 1m46.9s Examples | 9 9 8m04.7s Show | 7 7 3.1s RNG of the outermost testset: Random.Xoshiro(0xff9a67d095f29c0b, 0x5f1a0c6f2ca5fdd1, 0x5b4cd567e713b787, 0x8b843f587ad24d03, 0xb6067390fb074636) ERROR: LoadError: Some tests did not pass: 268 passed, 2 failed, 0 errored, 0 broken. in expression starting at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:242 Testing failed after 1951.4s ERROR: LoadError: Package Dispatcher errored during testing Stacktrace: [1] pkgerror(msg::String) @ Pkg.Types /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Types.jl:68 [2] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool) @ Pkg.Operations /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2672 [3] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/Operations.jl:2521 [inlined] [4] test(ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, force_latest_compatible_version::Bool, allow_earlier_backwards_compatible_versions::Bool, allow_reresolve::Bool, kwargs::@Kwargs{io::IOContext{IO}}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:538 [5] kwcall(::@NamedTuple{julia_args::Cmd, io::IOContext{IO}}, ::typeof(Pkg.API.test), ctx::Pkg.Types.Context, pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:515 [6] test(pkgs::Vector{PackageSpec}; io::IOContext{IO}, kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:168 [7] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkgs::Vector{PackageSpec}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:157 [8] test(pkgs::Vector{String}; kwargs::@Kwargs{julia_args::Cmd}) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [9] test @ /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:156 [inlined] [10] kwcall(::@NamedTuple{julia_args::Cmd}, ::typeof(Pkg.API.test), pkg::String) @ Pkg.API /opt/julia/share/julia/stdlib/v1.13/Pkg/src/API.jl:155 [11] top-level scope @ /PkgEval.jl/scripts/evaluate.jl:219 [12] include(mod::Module, _path::String) @ Base ./Base.jl:311 [13] exec_options(opts::Base.JLOptions) @ Base ./client.jl:320 [14] _start() @ Base ./client.jl:553 in expression starting at /PkgEval.jl/scripts/evaluate.jl:210 PkgEval failed after 2061.15s: illegal method overwrites during precompilation