Package evaluation to test Dispatcher on Julia 1.14.0-DEV.2362 (adf6a0d284*) started at 2026-06-15T17:28:49.007 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.14` Set-up completed after 15.49s ################################################################################ # Installation # Installing Dispatcher... Resolving package versions... Installed OrderedCollections ─ v1.8.2 Installed Statistics ───────── v1.11.1 Installed ArnoldiMethod ────── v0.1.0 Installed MacroTools ───────── v0.5.16 Installed Memento ──────────── v1.5.0 Installed ResultTypes ──────── v3.2.1 Installed DataStructures ───── v0.17.20 Installed Dispatcher ───────── v1.0.1 Installed PrecompileTools ──── v1.3.4 Installed StaticArrays ─────── v1.9.18 Installed DeferredFutures ──── v1.0.0 Installed SimpleTraits ─────── v0.9.6 Installed AutoHashEquals ───── v0.2.0 Installed IterTools ────────── v1.10.0 Installed Inflate ──────────── v0.1.5 Installed Requires ─────────── v1.3.1 Installed Preferences ──────── v1.5.2 Installed LightGraphs ──────── v1.3.5 Installed StaticArraysCore ─── v1.4.4 Updating `~/.julia/environments/v1.14/Project.toml` [a48d5fe2] + Dispatcher v1.0.1 Updating `~/.julia/environments/v1.14/Manifest.toml` ⌅ [ec485272] + ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] + AutoHashEquals v0.2.0 ⌅ [864edb3b] + DataStructures v0.17.20 [d2772ebe] + DeferredFutures v1.0.0 [a48d5fe2] + Dispatcher v1.0.1 [d25df0c9] + Inflate v0.1.5 [c8e1da08] + IterTools v1.10.0 [093fc24a] + LightGraphs v1.3.5 [1914dd2f] + MacroTools v0.5.16 [f28f55f0] + Memento v1.5.0 ⌅ [bac558e1] + OrderedCollections v1.8.2 [aea7be01] + PrecompileTools v1.3.4 [21216c6a] + Preferences v1.5.2 [ae029012] + Requires v1.3.1 ⌅ [08a2b407] + ResultTypes v3.2.1 [699a6c99] + SimpleTraits v0.9.6 [90137ffa] + StaticArrays v1.9.18 [1e83bf80] + StaticArraysCore v1.4.4 [10745b16] + Statistics v1.11.1 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.13.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.14.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v1.13.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.13.0 [f489334b] + StyledStrings v1.13.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.5.2+0 [4536629a] + OpenBLAS_jll v0.3.33+0 [bea87d4a] + SuiteSparse_jll v7.10.1+0 [8e850b90] + libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.42s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling project... 4.4 s ✓ TestEnv 1 dependency successfully precompiled in 5 seconds. 27 already precompiled. Precompiling package dependencies... Precompiling project... 3.2 s ✓ MacroTools 0.9 s ✓ StaticArraysCore 0.8 s ✓ Inflate 0.9 s ✓ IterTools 0.5 s ✓ ResultTypes 1.0 s ✓ OrderedCollections 0.7 s ✓ Statistics 0.5 s ✓ AutoHashEquals 0.9 s ✓ Requires 1.2 s ✓ Preferences 2.5 s ✓ SimpleTraits 3.2 s ✓ DataStructures 1.7 s ✓ Statistics → SparseArraysExt 1.3 s ✓ DeferredFutures 4.5 s ✓ Memento 1.5 s ✓ PrecompileTools 12.9 s ✓ StaticArrays 1.8 s ✓ StaticArrays → StaticArraysStatisticsExt 3.0 s ✓ ArnoldiMethod 9.8 s ✓ LightGraphs 6.0 s ✓ Dispatcher 21 dependencies successfully precompiled in 59 seconds. 18 already precompiled. Precompilation completed after 86.84s ################################################################################ # Testing # Testing Dispatcher Status `/tmp/jl_iUhnRp/Project.toml` ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [f28f55f0] Memento v1.5.0 ⌅ [08a2b407] ResultTypes v3.2.1 [8ba89e20] Distributed v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_iUhnRp/Manifest.toml` ⌅ [ec485272] ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [d25df0c9] Inflate v0.1.5 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [1914dd2f] MacroTools v0.5.16 [f28f55f0] Memento v1.5.0 ⌅ [bac558e1] OrderedCollections v1.8.2 [aea7be01] PrecompileTools v1.3.4 [21216c6a] Preferences v1.5.2 [ae029012] Requires v1.3.1 ⌅ [08a2b407] ResultTypes v3.2.1 [699a6c99] SimpleTraits v0.9.6 [90137ffa] StaticArrays v1.9.18 [1e83bf80] StaticArraysCore v1.4.4 [10745b16] Statistics v1.11.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.13.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.14.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v1.13.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.13.0 [f489334b] StyledStrings v1.13.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.5.2+0 [4536629a] OpenBLAS_jll v0.3.33+0 [bea87d4a] SuiteSparse_jll v7.10.1+0 [8e850b90] libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time Graph | 34 34 4.1s WARNING: Method definition foo(OtherModule.MyType) in module Main at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:367 overwritten at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:401. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op): complete. [info | Dispatcher]: Node 4 (Op, Op>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Main]: Partial array [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 4 graph nodes. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): running. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): complete. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): complete. [info | Dispatcher]: All 4 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Async - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException TaskFailedException nested task error: MethodError: no method matching /(::DependencyError{TaskFailedException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:640 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:571 /(!Matched::Missing, ::Number) @ Base missing.jl:120 ... Stacktrace: [1] (::var"#112#113"{Channel{Float64}})(x::DependencyError{TaskFailedException}) @ Main ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:661 [2] run!(op::Op) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:343 [3] (::Dispatcher.var"#dispatch!##0#dispatch!##1"{Op})() @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:421 Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{TaskFailedException}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#45#46"{Base.var"#47#48"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/pmap.jl:167 [3] (::Base.var"#iterate##9#iterate##10"{Base.AsyncCollector})(i::Int64, args::Tuple{Int64}) @ Base asyncmap.jl:250 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#iterate##9#iterate##10"{Base.AsyncCollector}, Channel{Any}, Nothing})() @ Base asyncmap.jl:176 Stacktrace: [1] (::Base.var"#wait_done##0#wait_done##1")(x::Task) @ Base asyncmap.jl:261 [inlined] [2] foreach(f::Base.var"#wait_done##0#wait_done##1", itr::Vector{Task}) @ Base abstractarray.jl:3284 [inlined] [3] wait_done(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) @ Base asyncmap.jl:261 [4] iterate(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) @ Base asyncmap.jl:275 [5] foreach(f::typeof(identity), itr::Base.AsyncCollector) @ Base abstractarray.jl:3284 [inlined] [6] asyncmap(f::Function, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base asyncmap.jl:85 [7] dispatch!(exec::AsyncExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [8] run!(exec::AsyncExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [9] run!(exec::AsyncExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [10] run!(exec::AsyncExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [11] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [13] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [15] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [17] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [18] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [19] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [20] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:980 [inlined] [21] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Parallel - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException MethodError: no method matching /(::DependencyError{RemoteException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:640 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:571 /(!Matched::Missing, ::Number) @ Base missing.jl:120 ... Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{MethodError}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#45#46"{Base.var"#47#48"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/pmap.jl:167 [3] (::Base.var"#iterate##9#iterate##10"{Base.AsyncCollector})(i::Int64, args::Tuple{Int64}) @ Base asyncmap.jl:250 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#iterate##9#iterate##10"{Base.AsyncCollector}, Channel{Any}, Nothing})() @ Base asyncmap.jl:176 Stacktrace: [1] (::Base.var"#wait_done##0#wait_done##1")(x::Task) @ Base asyncmap.jl:261 [inlined] [2] foreach(f::Base.var"#wait_done##0#wait_done##1", itr::Vector{Task}) @ Base abstractarray.jl:3284 [inlined] [3] wait_done(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) @ Base asyncmap.jl:261 [4] iterate(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) @ Base asyncmap.jl:275 [5] foreach(f::typeof(identity), itr::Base.AsyncCollector) @ Base abstractarray.jl:3284 [inlined] [6] asyncmap(f::Function, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base asyncmap.jl:85 [7] dispatch!(exec::ParallelExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [8] run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [9] run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [10] run!(exec::ParallelExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [11] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [12] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [13] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [14] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [15] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [16] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [17] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [18] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [19] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [20] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:980 [inlined] [21] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Warning: Failed to gracefully kill worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:754 ┌ Warning: Sending profile SIGUSR1 to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:757 From worker 20: From worker 20: ====================================================================================== From worker 20: Information request received. A stacktrace will print followed by a 1.0 second profile. From worker 20: --trace-compile is enabled during profile collection. From worker 20: ====================================================================================== From worker 20: From worker 20: cmd: /opt/julia/bin/julia 156 running 1 of 1 From worker 20: From worker 20: signal (10): User defined signal 1 From worker 20: _ZNK4llvm5APInt7umul_ovERKS0_Rb at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm23ObjectSizeOffsetVisitor15visitAllocaInstERNS_10AllocaInstE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. From worker 20: _ZN4llvm11InstVisitorINS_23ObjectSizeOffsetVisitorENS_10OffsetSpanEE5visitERNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm23ObjectSizeOffsetVisitor12computeValueEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm23ObjectSizeOffsetVisitor11computeImplEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm23ObjectSizeOffsetVisitor7computeEPNS_5ValueE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm13getObjectSizeEPKNS_5ValueERmRKNS_10DataLayoutEPKNS_17TargetLibraryInfoENS_14ObjectSizeOptsE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm13BasicAAResult10aliasCheckEPKNS_5ValueENS_12LocationSizeES3_S4_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm13BasicAAResult5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm9AAResults5aliasERKNS_14MemoryLocationES3_RNS_11AAQueryInfoEPKNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN12_GLOBAL__N_18DSEState11isOverwriteEPKN4llvm11InstructionES4_RKNS1_14MemoryLocationES7_RlS8_ at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN12_GLOBAL__N_18DSEState15getDomMemoryDefEPN4llvm9MemoryDefEPNS1_12MemoryAccessERKNS1_14MemoryLocationEPKNS1_5ValueERjSC_bSC_b at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN12_GLOBAL__N_1L19eliminateDeadStoresERN4llvm8FunctionERNS0_9AAResultsERNS0_9MemorySSAERNS0_13DominatorTreeERNS0_17PostDominatorTreeERKNS0_17TargetLibraryInfoERKNS0_8LoopInfoE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm7DSEPass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91:41 From worker 20: _ZN4llvm11PassManagerINS_8FunctionENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91:41 From worker 20: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: run at /source/usr/include/llvm/IR/PassManagerInternal.h:91:41 From worker 20: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: run at /source/src/pipeline.cpp:989:12 From worker 20: operator() at /source/src/jitlayers.cpp:1298:17 From worker 20: operator() at /source/src/jitlayers.cpp:1435:12 [inlined] From worker 20: optimizeModule at /source/src/jitlayers.cpp:2382:18 From worker 20: materialize at /source/src/jitlayers.cpp:905:31 From worker 20: _ZN4llvm3orc19MaterializationTask3runEv at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: dispatch at /source/src/julia-task-dispatcher.h:353:11 From worker 20: _ZN4llvm3orc16ExecutionSession22dispatchOutstandingMUsEv at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm3orc16ExecutionSession17OL_completeLookupESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EESt10shared_ptrINS0_23AsynchronousSymbolQueryEESt8functionIFvRKNS_8DenseMapIPNS0_8JITDylibENS_8DenseSetINS0_15SymbolStringPtrENS_12DenseMapInfoISF_vEEEENSG_ISD_vEENS_6detail12DenseMapPairISD_SI_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm3orc25InProgressFullLookupState8completeESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm3orc16ExecutionSession19OL_applyQueryPhase1ESt10unique_ptrINS0_21InProgressLookupStateESt14default_deleteIS3_EENS_5ErrorE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: _ZN4llvm3orc16ExecutionSession6lookupENS0_10LookupKindERKSt6vectorISt4pairIPNS0_8JITDylibENS0_19JITDylibLookupFlagsEESaIS8_EENS0_15SymbolLookupSetENS0_11SymbolStateENS_15unique_functionIFvNS_8ExpectedINS_8DenseMapINS0_15SymbolStringPtrENS0_17ExecutorSymbolDefENS_12DenseMapInfoISI_vEENS_6detail12DenseMapPairISI_SJ_EEEEEEEEESt8functionIFvRKNSH_IS6_NS_8DenseSetISI_SL_EENSK_IS6_vEENSN_IS6_SV_EEEEEE at /opt/julia/bin/../lib/julia/libLLVM.so.21.1jl (unknown line) From worker 20: publishCIs at /source/src/jitlayers.cpp:2085:14 From worker 20: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:510:39 From worker 20: jl_compile_method_very_internal at /source/src/gf.c:3946:27 From worker 20: _jl_invoke at /source/src/gf.c:4356:16 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 20: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 20: jl_f_invokelatest at /source/src/builtins.c:918:23 From worker 20: #start_gc_msgs_task##0 at /source/usr/share/julia/stdlib/v1.14/Distributed/src/remotecall.jl:288:0 (pc: 6) From worker 20: unknown function (ip: 0x7ba3c630ce0f) at (unknown file) From worker 20: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 20: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 20: start_task at /source/src/task.c:1276:19 From worker 20: unknown function (ip: (nil)) at (unknown file) From worker 20: From worker 20: #= 10.6 ms =# precompile(Tuple{typeof(Base.iterate), Float64}) From worker 20: #= 10.9 ms =# precompile(Tuple{Type{Base.TwicePrecision{Float64}}, Float64}) From worker 20: #= 14.1 ms =# precompile(Tuple{typeof(Base.twiceprecision), Base.TwicePrecision{Float64}, Int64}) From worker 20: #= 23.8 ms =# precompile(Tuple{Type{Base.StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64}}, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64, Int64}) From worker 20: #= 24.1 ms =# precompile(Tuple{Type{Base.StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, L} where L<:Integer}, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64, Int64}) From worker 20: #= 24.7 ms =# precompile(Tuple{Type{Base.StepRangeLen{T, R, S, L} where L<:Integer where S where R where T}, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64, Int64}) From worker 20: #= 25.4 ms =# precompile(Tuple{typeof(Base.steprangelen_hp), Type{Float64}, Float64, Float64, Int64, Int64, Int64}) From worker 20: #= 415.1 ms =# precompile(Tuple{Serialization.__deserialized_types__.var"#130#131"{Serialization.__deserialized_types__.var"#rand_sleep#rand_sleep##0"}}) From worker 20: #= 94.9 ms =# precompile(Tuple{typeof(Distributed.finalize_ref), Distributed.RemoteChannel{Base.Channel{Any}}}) From worker 20: #= 11.6 ms =# precompile(Tuple{Base.WeakKeyDictFinalizer{Base.WeakKeyDict{Distributed.AbstractRemoteRef, Nothing}}, Distributed.RemoteChannel{Base.Channel{Any}}}) From worker 20: #= 11.0 ms =# precompile(Tuple{Base.WeakKeyDictFinalizer{Base.WeakKeyDict{Any, Any}}, Core.TypeName}) From worker 20: #= 93.4 ms =# precompile(Tuple{typeof(Distributed.finalize_ref), Distributed.RemoteChannel{Base.Channel{Float64}}}) From worker 20: #= 11.4 ms =# precompile(Tuple{typeof(Base.isequal), Distributed.RemoteChannel{Base.Channel{Float64}}, WeakRef}) From worker 20: #= 14.0 ms =# precompile(Tuple{typeof(Base.:(var"==")), Distributed.RemoteChannel{Base.Channel{Float64}}, WeakRef}) From worker 20: #= 12.7 ms =# precompile(Tuple{typeof(Base.isequal), Distributed.RemoteChannel{Base.Channel{Float64}}, Distributed.RemoteChannel{Base.Channel{Float64}}}) From worker 20: #= 9.8 ms =# precompile(Tuple{Base.WeakKeyDictFinalizer{Base.WeakKeyDict{Distributed.AbstractRemoteRef, Nothing}}, Distributed.RemoteChannel{Base.Channel{Float64}}}) [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:761 [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Warning: Failed to gracefully kill worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:754 [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Warning: Sending profile SIGUSR1 to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:757 ┌ Warning: Failed to gracefully kill worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:754 From worker 22: ┌ Warning: Sending profile SIGUSR1 to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:757 From worker 22: ====================================================================================== From worker 22: Information request received. A stacktrace will print followed by a 1.0 second profile. From worker 22: --trace-compile is enabled during profile collection. From worker 22: ====================================================================================== From worker 22: From worker 22: cmd: /opt/julia/bin/julia 162 running 1 of 1 From worker 22: From worker 22: signal (10): User defined signal 1 [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. From worker 22: get at ./iddict.jl:95:0 [inlined] From worker 22: in at ./iddict.jl:185:0 [inlined] From worker 22: perform_lifting! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:900:0 From worker 22: perform_lifting! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:789:0 [inlined] From worker 22: lift_comparison_leaves! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:636:0 (pc: 457) From worker 22: lift_comparison! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:580:0 (pc: 231) From worker 22: sroa_pass! at ./../usr/share/julia/Compiler/src/ssair/passes.jl:1449:0 (pc: 2010) From worker 22: run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1048:0 (pc: 20) From worker 22: run_passes_ipo_safe at ./../usr/share/julia/Compiler/src/optimize.jl:1061:0 [inlined] From worker 22: optimize at ./../usr/share/julia/Compiler/src/optimize.jl:1034:0 [inlined] From worker 22: finish_nocycle at ./../usr/share/julia/Compiler/src/typeinfer.jl:278:0 (pc: 14) From worker 22: jfptr_finish_nocycle_1.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4985:0 (pc: 251) From worker 22: typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1537:0 (pc: 150) From worker 22: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1742:0 [inlined] From worker 22: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1751:0 (pc: 15) From worker 22: jfptr_typeinf_ext_toplevel_4.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 22: jl_type_infer at /source/src/gf.c:479:35 From worker 22: jl_compile_method_very_internal at /source/src/gf.c:3923:20 From worker 22: _jl_invoke at /source/src/gf.c:4356:16 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: iterate at ./asyncmap.jl:271:0 From worker 22: foreach at ./abstractarray.jl:3284:0 [inlined] From worker 22: #asyncmap#977 at ./asyncmap.jl:85:0 (pc: 23) From worker 22: asyncmap at ./asyncmap.jl:76:0 (pc: 2) From worker 22: unknown function (ip: 0x7ee452b6e606) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322:0 (pc: 2) From worker 22: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.14/Distributed/src/macros.jl:43:0 (pc: 2) From worker 22: unknown function (ip: 0x7ee452b6acff) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 22: jl_f_invokelatest at /source/src/builtins.c:918:23 From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 22: jl_f__apply_iterate at /source/src/builtins.c:905:26 From worker 22: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:283:0 From worker 22: run_work_thunk at /source/usr/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:70:0 (pc: 4) From worker 22: unknown function (ip: 0x7ee452b6a97b) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: run_work_thunk_remotevalue at /source/usr/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:79:0 (pc: 1) From worker 22: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:88:0 (pc: 3) From worker 22: unknown function (ip: 0x7ee452b6a54f) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4364:23 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4602:12 From worker 22: jl_apply at /source/src/julia.h:2388:12 [inlined] From worker 22: start_task at /source/src/task.c:1276:19 From worker 22: unknown function (ip: (nil)) at (unknown file) From worker 22: From worker 22: #= 19.3 ms =# precompile(Tuple{typeof(Base.:(>)), Float64, Float64}) From worker 22: #= 15.0 ms =# precompile(Tuple{typeof(Base.iterate), Float64}) From worker 22: #= 13.9 ms =# precompile(Tuple{Type{Base.TwicePrecision{Float64}}, Float64}) From worker 22: #= 18.5 ms =# precompile(Tuple{typeof(Base.twiceprecision), Base.TwicePrecision{Float64}, Int64}) From worker 22: #= 33.1 ms =# precompile(Tuple{Type{Base.StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64}}, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64, Int64}) From worker 22: #= 33.7 ms =# precompile(Tuple{Type{Base.StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, L} where L<:Integer}, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}, Int64, Int64}) From worker 22: From worker 22: ============================================================== From worker 22: Profile collected. A report will print at the next yield point. From worker 22: Disabling --trace-compile From worker 22: ============================================================== From worker 22: From worker 22: ┌ Warning: There were no samples collected in one or more groups. From worker 22: │ This may be due to idle threads, or you may need to run your From worker 22: │ program longer (perhaps by running it multiple times), From worker 22: │ or adjust the delay between samples with `Profile.init()`. From worker 22: └ @ Profile /opt/julia/share/julia/stdlib/v1.14/Profile/src/Profile.jl:1361 From worker 22: Overhead ╎ [+additional indent] Count File:Line Function From worker 22: ========================================================= From worker 22: Thread 1 (default) Task 0x00007ee4484b04c0 Total snapshots: 52. Utilization: 100% From worker 22: ╎52 @Distributed/…essages.jl:88 (::Distributed.var"#schedule_call##2#schedul… From worker 22: ╎ 52 @Distributed/…essages.jl:79 run_work_thunk_remotevalue(rv::Distributed.… From worker 22: ╎ 52 @Distributed/…essages.jl:70 run_work_thunk(thunk::Distributed.var"#han… From worker 22: ╎ 52 @Distributed/…ssages.jl:283 (::Distributed.var"#handle_msg##0#handle_… From worker 22: ╎ 52 @Distributed/…macros.jl:43 (::Dispatcher.var"#dispatch!##2#dispatch!… From worker 22: ╎ 52 @Dispatcher/…/nodes.jl:343 run!(op::Op) From worker 22: ╎ ╎ 52 @Compiler/…peinfer.jl:1751 typeinf_ext_toplevel(mi::Core.MethodIns… From worker 22: ╎ ╎ 52 @Compiler/…peinfer.jl:1742 typeinf_ext_toplevel(interp::Compiler.… From worker 22: ╎ ╎ 52 @Compiler/…einfer.jl:1537 typeinf_ext(interp::Compiler.NativeInt… From worker 22: ╎ ╎ 52 @Compiler/…tation.jl:4978 typeinf(interp::Compiler.NativeInterp… From worker 22: ╎ ╎ 52 @Compiler/…tation.jl:4700 typeinf_local(interp::Compiler.Nativ… From worker 22: ╎ ╎ ╎ 52 @Compiler/…ation.jl:4116 abstract_eval_basic_statement(interp… From worker 22: ╎ ╎ ╎ 52 @Compiler/…ation.jl:4159 abstract_eval_basic_statement(inter… From worker 22: ╎ ╎ ╎ 52 @Compiler/…tion.jl:3703 abstract_eval_statement_expr(interp… From worker 22: ╎ ╎ ╎ 52 @Compiler/…tion.jl:3333 abstract_eval_call(interp::Compile… From worker 22: ╎ ╎ ╎ 52 @Compiler/…tion.jl:3315 abstract_call(interp::Compiler.Na… From worker 22: ╎ ╎ ╎ ╎ 52 @Compiler/…ion.jl:3164 abstract_call(interp::Compiler.Na… From worker 22: ╎ ╎ ╎ ╎ 52 @Compiler/…ion.jl:3171 abstract_call(interp::Compiler.N… From worker 22: ╎ ╎ ╎ ╎ 52 @Compiler/…on.jl:3018 abstract_call_known(interp::Comp… From worker 22: ╎ ╎ ╎ ╎ 52 @Compiler/…on.jl:357 abstract_call_gf_by_type(interp:… From worker 22: ╎ ╎ ╎ ╎ 52 @Compiler/…on.jl:263 (::Compiler.var"#infercalls#abs… From worker 22: ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…on.jl:193 (::Compiler.var"#handle1#abstr… From worker 22: ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…n.jl:937 abstract_call_method_with_cons… From worker 22: ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…n.jl:969 abstract_call_method_with_con… From worker 22: ╎ ╎ ╎ ╎ ╎ 52 @Compiler/….jl:1475 const_prop_call(interp::Comp… From worker 22: ╎ ╎ ╎ ╎ ╎ 52 @Compiler/….jl:4978 typeinf(interp::Compiler.Na… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…jl:4700 typeinf_local(interp::Compi… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…jl:4116 abstract_eval_basic_statem… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:4159 abstract_eval_basic_statem… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3703 abstract_eval_statement_e… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3333 abstract_eval_call(inter… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3315 abstract_call(interp::C… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3164 abstract_call(interp::… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3171 abstract_call(interp:… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:3018 abstract_call_known(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:357 abstract_call_gf_by_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:263 (::Compiler.var"#in… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:193 (::Compiler.var"#h… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 52 @Compiler/…l:937 abstract_call_met… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 3 @Compiler/…l:944 abstract_call_me… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 3 @Compiler/…l:1109 concrete_eval_… From worker 22: 2╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +1 3 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 49 @Compiler/…l:969 abstract_call_me… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ 49 @Compiler/…l:1475 const_prop_cal… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +1 49 @Compiler/…l:4978 typeinf(interp… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +2 49 @Compiler/…l:4700 typeinf_local(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +3 49 @Compiler/…l:4116 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +4 49 @Compiler/…l:4159 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +5 49 @Compiler/…l:3703 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +6 49 @Compiler/…l:3333 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +7 49 @Compiler/…l:3315 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +8 49 @Compiler/…l:3164 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +9 49 @Compiler/…l:3171 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +10 12 @Compiler/…l:2900 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +11 12 @Compiler/…l:2098 abstract_apply… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +12 7 @Compiler/…l:1999 (::Compiler.va… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +13 7 @Compiler/…l:1729 precise_contai… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +14 7 @Compiler/…l:1782 abstract_itera… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +15 7 @Compiler/…l:2893 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +16 7 @Compiler/…l:3018 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +17 7 @Compiler/…l:357 abstract_call_g… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +18 7 @Compiler/…l:263 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +19 7 @Compiler/…l:193 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +20 7 @Compiler/…l:937 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +21 7 @Compiler/…l:944 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +22 7 @Compiler/…l:1109 concrete_eval_… From worker 22: 6╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +23 7 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +24 1 @Compiler/…l:1751 typeinf_ext_to… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +25 1 @Compiler/…l:1743 typeinf_ext_to… From worker 22: 1╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +26 1 @Compiler/…l:1736 add_codeinsts_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +12 5 @Compiler/…l:2078 (::Compiler.va… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +13 5 @Compiler/…l:3171 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +14 5 @Compiler/…l:3018 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +15 5 @Compiler/…l:357 abstract_call_g… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +16 5 @Compiler/…l:263 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +17 5 @Compiler/…l:193 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +18 5 @Compiler/…l:937 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +19 5 @Compiler/…l:944 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +20 5 @Compiler/…l:1109 concrete_eval_… From worker 22: 5╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +21 5 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +10 37 @Compiler/…l:3018 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +11 37 @Compiler/…l:357 abstract_call_g… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +12 37 @Compiler/…l:263 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +13 37 @Compiler/…l:193 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +14 37 @Compiler/…l:937 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +15 8 @Compiler/…l:944 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +16 8 @Compiler/…l:1109 concrete_eval_… From worker 22: 7╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +17 8 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +18 1 @Compiler/…l:1751 typeinf_ext_to… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +19 1 @Compiler/…l:1743 typeinf_ext_to… From worker 22: 1╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +20 1 @Compiler/…l:1736 add_codeinsts_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +15 28 @Compiler/…l:969 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +16 28 @Compiler/…l:1475 const_prop_cal… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +17 28 @Compiler/…l:4978 typeinf(interp… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +18 28 @Compiler/…l:4700 typeinf_local(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +19 28 @Compiler/…l:4116 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +20 28 @Compiler/…l:4159 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +21 28 @Compiler/…l:3703 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +22 28 @Compiler/…l:3333 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +23 28 @Compiler/…l:3315 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +24 28 @Compiler/…l:3164 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +25 28 @Compiler/…l:3171 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +26 28 @Compiler/…l:3018 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +27 28 @Compiler/…l:357 abstract_call_g… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +28 1 @Compiler/…l:182 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +29 1 @Compiler/…l:785 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +30 1 @Compiler/…l:1151 typeinf_edge(i… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +31 1 @Compiler/…l:577 get(cache::Comp… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +32 1 @Compiler/…l:200 get_indices(cac… From worker 22: 1╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +33 1 @Base/…ct.jl:95 get(d::IdDict{Co… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +28 27 @Compiler/…l:263 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +29 27 @Compiler/…l:193 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +30 27 @Compiler/…l:937 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +31 13 @Compiler/…l:969 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +32 13 @Compiler/…l:1475 const_prop_cal… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +33 13 @Compiler/…l:4978 typeinf(interp… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +34 13 @Compiler/…l:4700 typeinf_local(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +35 13 @Compiler/…l:4116 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +36 13 @Compiler/…l:4159 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +37 13 @Compiler/…l:3703 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +38 13 @Compiler/…l:3333 abstract_eval_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +39 13 @Compiler/…l:3315 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +40 13 @Compiler/…l:3164 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +41 13 @Compiler/…l:3171 abstract_call(… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +42 13 @Compiler/…l:3018 abstract_call_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +43 13 @Compiler/…l:357 abstract_call_g… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +44 13 @Compiler/…l:263 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +45 13 @Compiler/…l:193 (::Compiler.var… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +46 13 @Compiler/…l:937 abstract_call_m… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +47 13 @Compiler/…l:977 abstract_call_m… From worker 22: 12╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +48 13 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +49 1 @Compiler/…l:1751 typeinf_ext_to… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +50 1 @Compiler/…l:1743 typeinf_ext_to… From worker 22: 1╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +51 1 @Compiler/…l:1736 add_codeinsts_… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +31 14 @Compiler/…l:977 abstract_call_m… From worker 22: 14╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +32 14 @Compiler/…l:1125 _concrete_eval… From worker 22: ╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +15 1 @Compiler/…l:977 abstract_call_m… From worker 22: 1╎ ╎ ╎ ╎ ╎ ╎ ╎ ╎ +16 1 @Compiler/…l:1125 _concrete_eval… From worker 22: ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [notice | Dispatcher]: Handling Error: DependencyError ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 [notice | Dispatcher]: Handling Error: DependencyError ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base error.jl:56 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/messages.jl:115 [inlined] │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:102 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/process_messages.jl:106 ┌ Warning: Sending SIGQUIT to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:761 [notice | Dispatcher]: Handling Error: DependencyError ┌ Warning: Sending SIGQUIT to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.14/Distributed/src/managers.jl:761 [notice | Dispatcher]: Handling Error: DependencyError 2 procs removed (delay 0.3): Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:792 Expression: !(resp isa RemoteException) Evaluated: !(RemoteException(1, CapturedException(CapturedException(DependencyError{MethodError}(MethodError(/, (DependencyError{MethodError}(MethodError(getindex, (DependencyError{CapturedException}(CapturedException(DependencyError{CapturedException}(CapturedException(ProcessExitedException(22), Any[(try_yieldto(undo::typeof(identity)) at task.jl:1146, 1), (yieldto(t::Task, x::Any) at task.jl:1127, 1), (yieldto(t::Task) at task.jl:1113 [inlined], 1), (wait() at task.jl:1246, 1), (wait(c::Base.GenericCondition{ReentrantLock}; first::Bool) at condition.jl:141, 1), (wait(c::Base.GenericCondition{ReentrantLock}) at condition.jl:136 [inlined], 1), (take_buffered(c::Channel{Any}) at channels.jl:532, 1), (take!(c::Channel{Any}) at channels.jl:526, 1), (take!(::Distributed.RemoteValue) at remotecall.jl:728, 1), (remotecall_fetch(f::Function, w::Distributed.Worker, args::Distributed.RRID; kwargs::Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}) at remotecall.jl:463, 1), (remotecall_fetch(f::Function, w::Distributed.Worker, args::Distributed.RRID) at remotecall.jl:456, 1), (remotecall_fetch(f::typeof(Distributed.fetch_ref), id::Int64, args::Distributed.RRID; kwargs::Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}) at remotecall.jl:494 [inlined], 1), (call_on_owner(::typeof(Distributed.fetch_ref), ::RemoteChannel{Channel{Any}}) at remotecall.jl:567 [inlined], 1), (fetch(::RemoteChannel{Channel{Any}}) at remotecall.jl:658, 1), (fetch(ref::DeferredFuture) at DeferredFutures.jl:226, 1), (fetch(op::Op) at nodes.jl:295 [inlined], 1), ((::Dispatcher.var"#run!##0#run!##1")(node::Op) at nodes.jl:324, 1), ((::Base.var"#iterate##9#iterate##10"{Base.AsyncCollector})(i::Int64, args::Tuple{Op}) at asyncmap.jl:250, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#iterate##9#iterate##10"{Base.AsyncCollector}, Channel{Any}, Nothing})() at asyncmap.jl:176, 1)]), Any[((::Base.var"#wait_done##0#wait_done##1")(x::Task) at asyncmap.jl:261 [inlined], 1), (foreach(f::Base.var"#wait_done##0#wait_done##1", itr::Vector{Task}) at abstractarray.jl:3284 [inlined], 1), (wait_done(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:261, 1), (iterate(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:275, 1), (foreach(f::typeof(identity), itr::Base.AsyncCollector) at abstractarray.jl:3284 [inlined], 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op, Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}; ntasks::Int64, batch_size::Nothing) at asyncmap.jl:85, 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op, Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:76, 1), (run!(op::Op) at nodes.jl:322, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), ((::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}})() at remotecall.jl:427 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk_remotevalue(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 4), Any[(fetch(op::Op) at nodes.jl:298 [inlined], 1), ((::Dispatcher.var"#run!##0#run!##1")(node::Op) at nodes.jl:324, 1), ((::Base.var"#iterate##9#iterate##10"{Base.AsyncCollector})(i::Int64, args::Tuple{Op}) at asyncmap.jl:250, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#iterate##9#iterate##10"{Base.AsyncCollector}, Channel{Any}, Nothing})() at asyncmap.jl:176, 1)]), Any[((::Base.var"#wait_done##0#wait_done##1")(x::Task) at asyncmap.jl:261 [inlined], 1), (foreach(f::Base.var"#wait_done##0#wait_done##1", itr::Vector{Task}) at abstractarray.jl:3284 [inlined], 1), (wait_done(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:261, 1), (iterate(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:275, 1), (foreach(f::typeof(identity), itr::Base.AsyncCollector) at abstractarray.jl:3284 [inlined], 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}; ntasks::Int64, batch_size::Nothing) at asyncmap.jl:85, 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:76, 1), (run!(op::Op) at nodes.jl:322, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), ((::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}})() at remotecall.jl:427 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk_remotevalue(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 3), 2), 0x000000000000a290), Any[(getindex(r::RemoteChannel{Channel{Any}}, args::Int64) at remotecall.jl:782, 1), (getindex(ref::DeferredFuture, args::Int64) at DeferredFutures.jl:242, 1), (run!(node::IndexNode{Op}) at nodes.jl:442, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}})() at macros.jl:43, 1), ((::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}})() at remotecall.jl:427 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk_remotevalue(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 2), 2), 0x000000000000a290), Any[((::var"#140#141"{var"#rand_sleep#rand_sleep##0", RemoteChannel{Channel{Float64}}})(x::DependencyError{MethodError}) at runtests.jl:780, 1), (run!(op::Op) at nodes.jl:343, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), ((::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}})() at remotecall.jl:427 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk_remotevalue(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 1), Any[((::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{MethodError}) at executors.jl:282, 1), ((::Distributed.var"#183#184"{Bool, Base.var"#45#46"{Base.var"#47#48"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) at pmap.jl:167, 1), ((::Base.var"#iterate##9#iterate##10"{Base.AsyncCollector})(i::Int64, args::Tuple{Int64}) at asyncmap.jl:250, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#iterate##9#iterate##10"{Base.AsyncCollector}, Channel{Any}, Nothing})() at asyncmap.jl:176, 1)]), Any[((::Base.var"#wait_done##0#wait_done##1")(x::Task) at asyncmap.jl:261 [inlined], 1), (foreach(f::Base.var"#wait_done##0#wait_done##1", itr::Vector{Task}) at abstractarray.jl:3284 [inlined], 1), (wait_done(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:261, 1), (iterate(itr::Base.AsyncCollector, state::Base.AsyncCollectorState) at asyncmap.jl:275, 1), (foreach(f::typeof(identity), itr::Base.AsyncCollector) at abstractarray.jl:3284 [inlined], 1), (asyncmap(f::Function, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) at asyncmap.jl:85, 1), (dispatch!(exec::ParallelExecutor, graph::DispatchGraph; throw_error::Bool) at executors.jl:349, 1), (run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) at executors.jl:103, 1), (run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}) at executors.jl:81 [inlined], 1), (run!(exec::ParallelExecutor, output_nodes::Vector{Op}) at executors.jl:81 [inlined], 1), ((::var"#142#143"{Op, ParallelExecutor})() at macros.jl:86, 1), ((::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{var"#142#143"{Op, ParallelExecutor}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}})() at remotecall.jl:427 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{var"#142#143"{Op, ParallelExecutor}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk_remotevalue(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{var"#142#143"{Op, ParallelExecutor}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)])) isa RemoteException) Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:726 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2327 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:792 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined] 2 procs removed (delay 0.3): Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:793 Expression: isready(comm) Evaluated: isready(RemoteChannel{Channel{Float64}}(1, 1, 635)) Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2246 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:726 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:2327 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:793 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.14/Test/src/Test.jl:784 [inlined] ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile. --trace-compile is enabled during profile collection. ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404:0 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430:0 ijl_task_get_next at /source/src/scheduler.c:524:34 wait at ./task.jl:1248:0 (pc: 107) wait_forever at ./task.jl:1170:0 (pc: 4) jfptr_wait_forever_0.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4364:23 [inlined] ijl_apply_generic at /source/src/gf.c:4602:12 jl_apply at /source/src/julia.h:2388:12 [inlined] start_task at /source/src/task.c:1276:19 unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point. Disabling --trace-compile ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.14/Profile/src/Profile.jl:1361 Overhead ╎ [+additional indent] Count File:Line Function ========================================================= Thread 1 (default) Task 0x000076fa44a5aa40 Total snapshots: 769. Utilization: 0% ╎769 @Base/task.jl:1170 wait_forever() 768╎ 769 @Base/task.jl:1248 wait() [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404:0 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430:0 ijl_task_get_next at /source/src/scheduler.c:524:34 wait at ./task.jl:1248:0 (pc: 107) wait_forever at ./task.jl:1170:0 (pc: 4) jfptr_wait_forever_0.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4364:23 [inlined] ijl_apply_generic at /source/src/gf.c:4602:12 jl_apply at /source/src/julia.h:2388:12 [inlined] start_task at /source/src/task.c:1276:19 unknown function (ip: (nil)) at (unknown file) Allocations: 17910203 (Pool: 17909492; Big: 711); GC: 17 [99] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:242 unknown function (ip: 0x76ef7de8cf14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822:0 ijl_task_get_next at /source/src/scheduler.c:590:21 wait at ./task.jl:1248:0 (pc: 107) wait_forever at ./task.jl:1170:0 (pc: 4) jfptr_wait_forever_0.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4364:23 [inlined] ijl_apply_generic at /source/src/gf.c:4602:12 jl_apply at /source/src/julia.h:2388:12 [inlined] start_task at /source/src/task.c:1276:19 unknown function (ip: (nil)) at (unknown file) Allocations: 25792187 (Pool: 25791885; Big: 302); GC: 23 PkgEval terminated after 1236.33s: tests became inactive