Package evaluation to test Dispatcher on Julia 1.12.4 (0f21d93eaa*) started at 2026-01-26T19:58:47.502 ################################################################################ # Set-up # Installing PkgEval dependencies (TestEnv)... Activating project at `~/.julia/environments/v1.12` Set-up completed after 8.39s ################################################################################ # Installation # Installing Dispatcher... Resolving package versions... Updating `~/.julia/environments/v1.12/Project.toml` [a48d5fe2] + Dispatcher v1.0.1 Updating `~/.julia/environments/v1.12/Manifest.toml` ⌅ [ec485272] + ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] + AutoHashEquals v0.2.0 ⌅ [864edb3b] + DataStructures v0.17.20 [d2772ebe] + DeferredFutures v1.0.0 [a48d5fe2] + Dispatcher v1.0.1 [d25df0c9] + Inflate v0.1.5 [c8e1da08] + IterTools v1.10.0 [093fc24a] + LightGraphs v1.3.5 [1914dd2f] + MacroTools v0.5.16 [f28f55f0] + Memento v1.4.1 [bac558e1] + OrderedCollections v1.8.1 [aea7be01] + PrecompileTools v1.3.3 [21216c6a] + Preferences v1.5.1 [ae029012] + Requires v1.3.1 ⌅ [08a2b407] + ResultTypes v3.2.1 [699a6c99] + SimpleTraits v0.9.5 [90137ffa] + StaticArrays v1.9.16 [1e83bf80] + StaticArraysCore v1.4.4 [10745b16] + Statistics v1.11.1 [56f22d72] + Artifacts v1.11.0 [2a0f44e3] + Base64 v1.11.0 [ade2ca70] + Dates v1.11.0 [8ba89e20] + Distributed v1.11.0 [b77e0a4c] + InteractiveUtils v1.11.0 [ac6e5ff7] + JuliaSyntaxHighlighting v1.12.0 [8f399da3] + Libdl v1.11.0 [37e2e46d] + LinearAlgebra v1.12.0 [56ddb016] + Logging v1.11.0 [d6f4376e] + Markdown v1.11.0 [a63ad114] + Mmap v1.11.0 [de0858da] + Printf v1.11.0 [9a3f8284] + Random v1.11.0 [ea8e919c] + SHA v0.7.0 [9e88b42a] + Serialization v1.11.0 [1a1011a3] + SharedArrays v1.11.0 [6462fe0b] + Sockets v1.11.0 [2f01184e] + SparseArrays v1.12.0 [f489334b] + StyledStrings v1.11.0 [fa267f1f] + TOML v1.0.3 [8dfed614] + Test v1.11.0 [cf7118a7] + UUIDs v1.11.0 [4ec0a83e] + Unicode v1.11.0 [e66e0078] + CompilerSupportLibraries_jll v1.3.0+1 [4536629a] + OpenBLAS_jll v0.3.29+0 [bea87d4a] + SuiteSparse_jll v7.8.3+2 [8e850b90] + libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated -m` Installation completed after 5.23s ################################################################################ # Precompilation # Precompiling PkgEval dependencies... Precompiling package dependencies... Precompiling packages... 1015.3 ms ✓ ResultTypes 10078.7 ms ✓ LightGraphs 5703.1 ms ✓ Dispatcher 3 dependencies successfully precompiled in 17 seconds. 36 already precompiled. Precompilation completed after 35.14s ################################################################################ # Testing # Testing Dispatcher Status `/tmp/jl_0kMSrH/Project.toml` ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [f28f55f0] Memento v1.4.1 ⌅ [08a2b407] ResultTypes v3.2.1 [8ba89e20] Distributed v1.11.0 [8dfed614] Test v1.11.0 Status `/tmp/jl_0kMSrH/Manifest.toml` ⌅ [ec485272] ArnoldiMethod v0.1.0 ⌅ [15f4f7f2] AutoHashEquals v0.2.0 ⌅ [864edb3b] DataStructures v0.17.20 [d2772ebe] DeferredFutures v1.0.0 [a48d5fe2] Dispatcher v1.0.1 [d25df0c9] Inflate v0.1.5 [c8e1da08] IterTools v1.10.0 [093fc24a] LightGraphs v1.3.5 [1914dd2f] MacroTools v0.5.16 [f28f55f0] Memento v1.4.1 [bac558e1] OrderedCollections v1.8.1 [aea7be01] PrecompileTools v1.3.3 [21216c6a] Preferences v1.5.1 [ae029012] Requires v1.3.1 ⌅ [08a2b407] ResultTypes v3.2.1 [699a6c99] SimpleTraits v0.9.5 [90137ffa] StaticArrays v1.9.16 [1e83bf80] StaticArraysCore v1.4.4 [10745b16] Statistics v1.11.1 [56f22d72] Artifacts v1.11.0 [2a0f44e3] Base64 v1.11.0 [ade2ca70] Dates v1.11.0 [8ba89e20] Distributed v1.11.0 [b77e0a4c] InteractiveUtils v1.11.0 [ac6e5ff7] JuliaSyntaxHighlighting v1.12.0 [8f399da3] Libdl v1.11.0 [37e2e46d] LinearAlgebra v1.12.0 [56ddb016] Logging v1.11.0 [d6f4376e] Markdown v1.11.0 [a63ad114] Mmap v1.11.0 [de0858da] Printf v1.11.0 [9a3f8284] Random v1.11.0 [ea8e919c] SHA v0.7.0 [9e88b42a] Serialization v1.11.0 [1a1011a3] SharedArrays v1.11.0 [6462fe0b] Sockets v1.11.0 [2f01184e] SparseArrays v1.12.0 [f489334b] StyledStrings v1.11.0 [fa267f1f] TOML v1.0.3 [8dfed614] Test v1.11.0 [cf7118a7] UUIDs v1.11.0 [4ec0a83e] Unicode v1.11.0 [e66e0078] CompilerSupportLibraries_jll v1.3.0+1 [4536629a] OpenBLAS_jll v0.3.29+0 [bea87d4a] SuiteSparse_jll v7.8.3+2 [8e850b90] libblastrampoline_jll v5.15.0+0 Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. Testing Running tests... Test Summary: | Pass Total Time Graph | 34 34 5.9s WARNING: Method definition foo(OtherModule.MyType) in module Main at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:367 overwritten at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:401. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op): complete. [info | Dispatcher]: Node 4 (Op, Op>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Main]: Partial array [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (Op): running. [info | Dispatcher]: Node 2 (Op): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 2 graph nodes. [info | Dispatcher]: Node 1 (Op>): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): running. [info | Dispatcher]: Node 2 (DataNode{Channel{Float64}}): complete. [info | Dispatcher]: Node 1 (Op>): complete. [info | Dispatcher]: All 2 nodes executed. [info | Dispatcher]: Executing 4 graph nodes. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): running. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): running. [info | Dispatcher]: Node 4 (Op<+, Int64, Int64>): complete. [info | Dispatcher]: Node 2 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 3 (Op<+, Op<+>, Int64>): complete. [info | Dispatcher]: Node 1 (Op<*, Op<+>, Op<+>>): complete. [info | Dispatcher]: All 4 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Async - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException TaskFailedException nested task error: MethodError: no method matching /(::DependencyError{TaskFailedException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:639 /(!Matched::Missing, ::Number) @ Base missing.jl:123 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:566 ... Stacktrace: [1] (::var"#112#113"{Channel{Float64}})(x::DependencyError{TaskFailedException}) @ Main ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:661 [2] run!(op::Op) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:343 [3] (::Dispatcher.var"#dispatch!##0#dispatch!##1"{Op})() @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:421 Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{TaskFailedException}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/pmap.jl:167 [3] (::Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}})(r::Base.RefValue{Any}, args::Tuple{Int64}) @ Base ./asyncmap.jl:96 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}}, Channel{Any}, Nothing})() @ Base ./asyncmap.jl:230 Stacktrace: [1] (::Base.var"#maptwice##0#maptwice##1")(x::Task) @ Base ./asyncmap.jl:173 [2] foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) @ Base ./abstractarray.jl:3188 [3] maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::UnitRange{Int64}) @ Base ./asyncmap.jl:173 [4] wrap_n_exec_twice @ ./asyncmap.jl:149 [inlined] [5] async_usemap(f::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{AsyncExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base ./asyncmap.jl:99 [6] async_usemap @ ./asyncmap.jl:80 [inlined] [7] #asyncmap#923 @ ./asyncmap.jl:77 [inlined] [8] asyncmap @ ./asyncmap.jl:76 [inlined] [9] dispatch!(exec::AsyncExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [10] dispatch! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:244 [inlined] [11] run!(exec::AsyncExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [12] run! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [13] run!(exec::AsyncExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [14] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [15] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [16] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [18] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [20] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [22] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:774 [inlined] [24] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:632 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:667 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError Parallel - Application Errors: Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 Expression: run!(exec, [h]) Expected: DependencyError Thrown: CapturedException MethodError: no method matching /(::DependencyError{RemoteException}, ::Int64) The function `/` exists, but no method is defined for this combination of argument types. Closest candidates are: /(!Matched::BigFloat, ::Union{Int16, Int32, Int64, Int8}) @ Base mpfr.jl:639 /(!Matched::Missing, ::Number) @ Base missing.jl:123 /(!Matched::BigInt, ::Union{Int16, Int32, Int64, Int8, UInt16, UInt32, UInt64, UInt8}) @ Base gmp.jl:566 ... Stacktrace: [1] (::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{MethodError}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:282 [2] (::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/pmap.jl:167 [3] (::Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}})(r::Base.RefValue{Any}, args::Tuple{Int64}) @ Base ./asyncmap.jl:96 [4] (::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}}, Channel{Any}, Nothing})() @ Base ./asyncmap.jl:230 Stacktrace: [1] (::Base.var"#maptwice##0#maptwice##1")(x::Task) @ Base ./asyncmap.jl:173 [2] foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) @ Base ./abstractarray.jl:3188 [3] maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::UnitRange{Int64}) @ Base ./asyncmap.jl:173 [4] wrap_n_exec_twice @ ./asyncmap.jl:149 [inlined] [5] async_usemap(f::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) @ Base ./asyncmap.jl:99 [6] async_usemap @ ./asyncmap.jl:80 [inlined] [7] #asyncmap#923 @ ./asyncmap.jl:77 [inlined] [8] asyncmap @ ./asyncmap.jl:76 [inlined] [9] dispatch!(exec::ParallelExecutor, graph::DispatchGraph; throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:349 [10] dispatch! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:244 [inlined] [11] run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:103 [12] run! @ ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [inlined] [13] run!(exec::ParallelExecutor, output_nodes::Vector{Op}) @ Dispatcher ~/.julia/packages/Dispatcher/JXmtG/src/executors.jl:81 [14] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [15] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [16] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [17] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [18] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [19] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [20] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [21] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [22] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [23] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:774 [inlined] [24] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:677 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:713 [inlined] [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 6: From worker 6: ====================================================================================== From worker 6: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 6: ====================================================================================== From worker 6: From worker 6: cmd: /opt/julia/bin/julia 43 running 1 of 1 From worker 6: From worker 6: signal (10): User defined signal 1 From worker 6: _ZNK4llvm14TargetLowering20SimplifyDemandedBitsENS_7SDValueERKNS_5APIntES4_RNS_9KnownBitsERNS0_17TargetLoweringOptEjb at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZNK4llvm14TargetLowering20SimplifyDemandedBitsENS_7SDValueERKNS_5APIntES4_RNS_9KnownBitsERNS0_17TargetLoweringOptEjb at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZNK4llvm14TargetLowering20SimplifyDemandedBitsENS_7SDValueERKNS_5APIntERNS_9KnownBitsERNS0_17TargetLoweringOptEjb at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_111DAGCombiner20SimplifyDemandedBitsEN4llvm7SDValueE.constprop.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_111DAGCombiner12visitADDLikeEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_111DAGCombiner8visitADDEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_111DAGCombiner7combineEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_111DAGCombiner3RunEN4llvm12CombineLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm12SelectionDAG7CombineENS_12CombineLevelEPNS_9AAResultsENS_15CodeGenOptLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm16SelectionDAGISel17CodeGenAndEmitDAGEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm16SelectionDAGISel20SelectAllBasicBlocksERKNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm16SelectionDAGISel20runOnMachineFunctionERNS_15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN12_GLOBAL__N_115X86DAGToDAGISel20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 6: operator() at /source/src/jitlayers.cpp:1561 From worker 6: addModule at /source/src/jitlayers.cpp:2044 From worker 6: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 6: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 6: jl_compile_method_internal at /source/src/gf.c:3524 From worker 6: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4210 From worker 6: serialize_msg at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:78 From worker 6: unknown function (ip: 0x7cd1827766d6) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4210 From worker 6: jl_apply at /source/src/julia.h:2391 [inlined] From worker 6: jl_f_invokelatest at /source/src/builtins.c:881 From worker 6: send_msg_ at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:181 From worker 6: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 6: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 6: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 6: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 6: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 6: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 6: unknown function (ip: 0x7cd182775822) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4210 From worker 6: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 6: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 6: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 6: #938 at ./asyncmap.jl:96 From worker 6: unknown function (ip: 0x7cd182775356) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4210 From worker 6: jl_apply at /source/src/julia.h:2391 [inlined] From worker 6: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 6: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 6: unknown function (ip: 0x7cd18277249f) at (unknown file) From worker 6: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 6: ijl_apply_generic at /source/src/gf.c:4210 From worker 6: jl_apply at /source/src/julia.h:2391 [inlined] From worker 6: start_task at /source/src/task.c:1252 From worker 6: unknown function (ip: (nil)) at (unknown file) From worker 6: From worker 6: ============================================================== From worker 6: Profile collected. A report will print at the next yield point From worker 6: ============================================================== From worker 6: [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. ┌ Warning: Sending SIGQUIT to worker 6 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 8: From worker 8: ====================================================================================== From worker 8: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 8: ====================================================================================== From worker 8: From worker 8: cmd: /opt/julia/bin/julia 51 running 1 of 1 From worker 8: From worker 8: signal (10): User defined signal 1 From worker 8: _ZN4llvm19InstructionWorklist4pushEPNS_11InstructionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZN4llvm16InstCombinerImpl22freelyInvertAllUsersOfEPNS_5ValueES2_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZN4llvm16InstCombinerImpl7foldNotERNS_14BinaryOperatorE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZN4llvm16InstCombinerImpl8visitXorERNS_14BinaryOperatorE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZN4llvm16InstCombinerImpl3runEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZL31combineInstructionsOverFunctionRN4llvm8FunctionERNS_19InstructionWorklistEPNS_9AAResultsERNS_15AssumptionCacheERNS_17TargetLibraryInfoERNS_19TargetTransformInfoERNS_13DominatorTreeERNS_25OptimizationRemarkEmitterEPNS_18BlockFrequencyInfoEPNS_18ProfileSummaryInfoEPNS_8LoopInfoERKNS_18InstCombineOptionsE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: _ZN4llvm15InstCombinePass3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 8: run at /source/usr/include/llvm/IR/PassManager.h:543 [inlined] From worker 8: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 8: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 8: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 8: run at /source/src/pipeline.cpp:741 From worker 8: operator() at /source/src/jitlayers.cpp:1459 From worker 8: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 8: operator() at /source/src/jitlayers.cpp:1420 [inlined] From worker 8: operator() at /source/src/jitlayers.cpp:1572 [inlined] From worker 8: addModule at /source/src/jitlayers.cpp:2031 From worker 8: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 8: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 8: jl_compile_method_internal at /source/src/gf.c:3524 From worker 8: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 8: unknown function (ip: 0x785ac9f79f1f) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: unknown function (ip: (nil)) at (unknown file) From worker 8: From worker 8: ============================================================== From worker 8: Profile collected. A report will print at the next yield point From worker 8: ============================================================== From worker 8: [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Warning: Sending SIGQUIT to worker 8 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 From worker 8: From worker 8: [51] signal 3: Quit From worker 8: ==== Thread 1 created 213 live tasks From worker 8: ---- Root task (0x785ab0ffc010) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #start_worker#24 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:276 From worker 8: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:237 From worker 8: unknown function (ip: 0x785ac9f0fa56) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: #start_worker#23 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 8: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 8: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 8: process_opts at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:1387 From worker 8: unknown function (ip: 0x785ac9f043f2) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: exec_options at ./client.jl:263 From worker 8: _start at ./client.jl:550 From worker 8: jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: true_main at /source/src/jlapi.c:971 From worker 8: jl_repl_entrypoint at /source/src/jlapi.c:1139 From worker 8: main at /source/cli/loader_exe.c:58 From worker 8: unknown function (ip: 0x785acb4e2249) at /lib/x86_64-linux-gnu/libc.so.6 From worker 8: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) From worker 8: unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S From worker 8: ---- End root task From worker 8: ---- Task 1 (0x785ab0ffc1f0) From worker 8: (sticky: 0, started: 1, state: 0, tid: 1) From worker 8: jl_record_backtrace at /source/src/stackwalk.c:1299 From worker 8: jlbacktracet at /source/src/stackwalk.c:1398 From worker 8: jl_print_task_backtraces at /source/src/stackwalk.c:1458 From worker 8: jl_critical_error at /source/src/signal-handling.c:640 From worker 8: jl_exit_thread0_cb at /source/src/signals-unix.c:563 From worker 8: ---- End task 1 From worker 8: ---- Task 2 (0x785ab0ffd2d0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: wait at ./condition.jl:136 [inlined] From worker 8: #start_gc_msgs_task##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:281 [inlined] From worker 8: lock at ./lock.jl:335 From worker 8: lock at ./condition.jl:80 [inlined] From worker 8: #start_gc_msgs_task##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:279 From worker 8: unknown function (ip: 0x785ac9f0ebef) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 2 From worker 8: ---- Task 3 (0x785ab2b35d20) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:699 From worker 8: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:153 [inlined] From worker 8: #26 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:256 From worker 8: unknown function (ip: 0x785ac9f12eef) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 3 From worker 8: ---- Task 4 (0x785ab4b24c40) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: wait_readnb at ./stream.jl:392 From worker 8: wait_locked at ./stream.jl:982 From worker 8: unsafe_read at ./stream.jl:988 From worker 8: unsafe_read at ./io.jl:890 [inlined] From worker 8: unsafe_read at ./io.jl:889 From worker 8: read! at ./io.jl:894 [inlined] From worker 8: deserialize_hdr_raw at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:167 [inlined] From worker 8: message_handler_loop at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:172 From worker 8: process_tcp_streams at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:133 From worker 8: #process_messages##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:121 From worker 8: unknown function (ip: 0x785ac9f21615) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 4 From worker 8: ---- Task 5 (0x785a9ef961d0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: take_buffered at ./channels.jl:527 From worker 8: take! at ./channels.jl:526 From worker 8: unknown function (ip: 0x785ac9f7c532) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 8: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 8: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 8: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 8: unknown function (ip: 0x785ac9f6fd92) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: getindex at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:242 From worker 8: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:442 From worker 8: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 8: unknown function (ip: 0x785ac9f6f43f) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: unknown function (ip: 0x785ac9f6f30b) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 8: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 8: unknown function (ip: 0x785ac9f6ebbf) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 5 From worker 8: ---- Task 6 (0x785a9ef964a0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: fetch_buffered at ./channels.jl:481 From worker 8: fetch at ./channels.jl:480 From worker 8: unknown function (ip: 0x785ac9f41932) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 8: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 8: unknown function (ip: 0x785ac9f76e69) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 8: unknown function (ip: 0x785ac9f76957) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 6 From worker 8: ---- Task 7 (0x785a9ee341f0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: wait at ./condition.jl:136 [inlined] From worker 8: _wait at ./task.jl:312 From worker 8: #wait#582 at ./task.jl:361 [inlined] From worker 8: wait at ./task.jl:360 [inlined] From worker 8: fetch at ./task.jl:554 [inlined] From worker 8: #maptwice##0 at ./asyncmap.jl:173 From worker 8: unknown function (ip: 0x785ac9f7c4a2) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: foreach at ./abstractarray.jl:3188 From worker 8: maptwice at ./asyncmap.jl:173 From worker 8: asyncmap at ./asyncmap.jl:76 From worker 8: unknown function (ip: 0x785ac9f78826) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 8: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 8: unknown function (ip: 0x785ac9f76ebf) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: unknown function (ip: 0x785ac9f6f30b) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 8: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 8: unknown function (ip: 0x785ac9f6ebbf) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 7 From worker 8: ---- Task 8 (0x785a9ee343d0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: fetch_buffered at ./channels.jl:481 From worker 8: fetch at ./channels.jl:480 From worker 8: unknown function (ip: 0x785ac9f41932) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 8: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 8: unknown function (ip: 0x785ac9f76e69) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 8: unknown function (ip: 0x785ac9f76957) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 8 From worker 8: ---- Task 9 (0x785a9ee345b0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: _trywait at ./asyncevent.jl:163 From worker 8: wait at ./asyncevent.jl:202 [inlined] From worker 8: sleep at ./asyncevent.jl:312 [inlined] From worker 8: rand_sleep at ./none (unknown line) [inlined] From worker 8: rand_sleep at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:0 From worker 8: #132 at ./none (unknown line) [inlined] From worker 8: #132 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:0 From worker 8: unknown function (ip: 0x785ac9f84dd8) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:343 From worker 8: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 8: unknown function (ip: 0x785ac9f76ebf) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: unknown function (ip: 0x785ac9f6f30b) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 8: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 8: unknown function (ip: 0x785ac9f6ebbf) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 9 From worker 8: ---- Task 10 (0x785a9ee34790) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: fetch_buffered at ./channels.jl:481 From worker 8: fetch at ./channels.jl:480 From worker 8: unknown function (ip: 0x785ac9f41932) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 8: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 8: unknown function (ip: 0x785ac9f76e69) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 8: unknown function (ip: 0x785ac9f76957) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 10 From worker 8: ---- Task 11 (0x785aa11b9e10) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: take_buffered at ./channels.jl:527 From worker 8: take! at ./channels.jl:526 From worker 8: unknown function (ip: 0x785ac9f7c532) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 8: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 8: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 8: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 8: unknown function (ip: 0x785ac9f6fd92) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 8: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:295 [inlined] From worker 8: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 8: #938 at ./asyncmap.jl:96 From worker 8: unknown function (ip: 0x785ac9f7c6c6) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 8: unknown function (ip: 0x785ac9f79f1f) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 11 From worker 8: ---- Task 12 (0x785aa11b9f00) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_swap_fiber at /source/src/task.c:1348 From worker 8: ctx_switch at /source/src/task.c:587 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: take_buffered at ./channels.jl:527 From worker 8: take! at ./channels.jl:526 From worker 8: unknown function (ip: 0x785ac9f7c532) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 8: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 8: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 8: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 8: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 8: unknown function (ip: 0x785ac9f6fd92) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 8: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:295 [inlined] From worker 8: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 8: #938 at ./asyncmap.jl:96 From worker 8: unknown function (ip: 0x785ac9f7c6c6) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 8: unknown function (ip: 0x785ac9f79f1f) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 12 From worker 8: ---- Task 211 (0x785aa159e2c0) From worker 8: (sticky: 1, started: 1, state: 0, tid: 1) From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: try_yieldto at ./task.jl:1143 From worker 8: wait at ./task.jl:1229 From worker 8: #wait#398 at ./condition.jl:141 From worker 8: wait at ./condition.jl:136 [inlined] From worker 8: _wait at ./task.jl:312 From worker 8: #start_profile_listener##2 at ./Base.jl:359 From worker 8: jfptr_YY.start_profile_listenerYY.YY.2_16938.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: _atexit at ./initdefs.jl:464 From worker 8: unknown function (ip: 0x785ac9f7f404) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: ijl_atexit_hook at /source/src/init.c:260 From worker 8: ijl_exit at /source/src/init.c:196 From worker 8: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 8: exit at ./initdefs.jl:28 From worker 8: exit at ./initdefs.jl:29 From worker 8: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f_invokelatest at /source/src/builtins.c:881 From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 8: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 8: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 8: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 8: unknown function (ip: 0x785ac9f3e0af) at (unknown file) From worker 8: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 8: ijl_apply_generic at /source/src/gf.c:4210 From worker 8: jl_apply at /source/src/julia.h:2391 [inlined] From worker 8: start_task at /source/src/task.c:1252 From worker 8: ---- End task 211 From worker 8: ==== End thread 1 From worker 8: ==== Done From worker 8: in expression starting at none:0 From worker 8: jl_start_fiber_swap at /source/src/task.c:1438 From worker 8: ctx_switch at /source/src/task.c:650 From worker 8: ijl_switch at /source/src/task.c:690 From worker 8: Allocations: 9416541 (Pool: 9416502; Big: 39); GC: 7 ┌ Warning: Worker 8 ignored SIGQUIT, sending SIGKILL └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:765 [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 10: From worker 10: ====================================================================================== From worker 10: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 10: ====================================================================================== From worker 10: From worker 10: cmd: /opt/julia/bin/julia 59 running 1 of 1 From worker 10: From worker 10: signal (10): User defined signal 1 From worker 10: _ZN4llvm20LoopInstSimplifyPass3runERNS_4LoopERNS_15AnalysisManagerIS1_JRNS_27LoopStandardAnalysisResultsEEEES5_RNS_10LPMUpdaterE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 10: _ZN4llvm11PassManagerINS_4LoopENS_15AnalysisManagerIS1_JRNS_27LoopStandardAnalysisResultsEEEEJS4_RNS_10LPMUpdaterEEE13runSinglePassIS1_St10unique_ptrINS_6detail11PassConceptIS1_S5_JS4_S7_EEESt14default_deleteISD_EEEESt8optionalINS_17PreservedAnalysesEERT_RT0_RS5_S4_S7_RNS_19PassInstrumentationE.isra.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: _ZN4llvm11PassManagerINS_4LoopENS_15AnalysisManagerIS1_JRNS_27LoopStandardAnalysisResultsEEEEJS4_RNS_10LPMUpdaterEEE24runWithoutLoopNestPassesERS1_RS5_S4_S7_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: _ZN4llvm11PassManagerINS_4LoopENS_15AnalysisManagerIS1_JRNS_27LoopStandardAnalysisResultsEEEEJS4_RNS_10LPMUpdaterEEE3runERS1_RS5_S4_S7_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 10: _ZN4llvm25FunctionToLoopPassAdaptor3runERNS_8FunctionERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 10: run at /source/usr/include/llvm/IR/PassManager.h:543 [inlined] From worker 10: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 10: _ZN4llvm27ModuleToFunctionPassAdaptor3runERNS_6ModuleERNS_15AnalysisManagerIS1_JEEE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: run at /source/usr/include/llvm/IR/PassManagerInternal.h:89 From worker 10: _ZN4llvm11PassManagerINS_6ModuleENS_15AnalysisManagerIS1_JEEEJEE3runERS1_RS3_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 10: run at /source/src/pipeline.cpp:741 From worker 10: operator() at /source/src/jitlayers.cpp:1459 From worker 10: withModuleDo<(anonymous namespace)::sizedOptimizerT::operator()(llvm::orc::ThreadSafeModule) [with long unsigned int N = 4]:: > at /source/usr/include/llvm/ExecutionEngine/Orc/ThreadSafeModule.h:136 [inlined] From worker 10: operator() at /source/src/jitlayers.cpp:1420 [inlined] From worker 10: operator() at /source/src/jitlayers.cpp:1572 [inlined] From worker 10: addModule at /source/src/jitlayers.cpp:2031 From worker 10: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 10: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 10: jl_compile_method_internal at /source/src/gf.c:3524 From worker 10: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: serialize_msg at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:78 From worker 10: unknown function (ip: 0x792cbb3799c6) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: send_msg_ at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:181 From worker 10: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 10: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 10: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 10: unknown function (ip: 0x792cbb378b92) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 10: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 10: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 10: #938 at ./asyncmap.jl:96 From worker 10: unknown function (ip: 0x792cbb378166) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 10: unknown function (ip: 0x792cbb373f2f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: unknown function (ip: (nil)) at (unknown file) From worker 10: From worker 10: ============================================================== From worker 10: Profile collected. A report will print at the next yield point From worker 10: ============================================================== From worker 10: [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. ┌ Warning: Sending SIGQUIT to worker 10 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 From worker 10: From worker 10: [59] signal 3: Quit From worker 10: ==== Thread 1 created 313 live tasks From worker 10: ---- Root task (0x792ca23fc010) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #start_worker#24 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:276 From worker 10: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:237 From worker 10: unknown function (ip: 0x792cbb30fa76) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: #start_worker#23 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 10: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 10: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 10: process_opts at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:1387 From worker 10: unknown function (ip: 0x792cbb304402) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: exec_options at ./client.jl:263 From worker 10: _start at ./client.jl:550 From worker 10: jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: true_main at /source/src/jlapi.c:971 From worker 10: jl_repl_entrypoint at /source/src/jlapi.c:1139 From worker 10: main at /source/cli/loader_exe.c:58 From worker 10: unknown function (ip: 0x792cbc8e2249) at /lib/x86_64-linux-gnu/libc.so.6 From worker 10: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) From worker 10: unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S From worker 10: ---- End root task From worker 10: ---- Task 1 (0x792ca23fc1f0) From worker 10: (sticky: 0, started: 1, state: 0, tid: 1) From worker 10: jl_record_backtrace at /source/src/stackwalk.c:1299 From worker 10: jlbacktracet at /source/src/stackwalk.c:1398 From worker 10: jl_print_task_backtraces at /source/src/stackwalk.c:1458 From worker 10: jl_critical_error at /source/src/signal-handling.c:640 From worker 10: jl_exit_thread0_cb at /source/src/signals-unix.c:563 From worker 10: ---- End task 1 From worker 10: ---- Task 2 (0x792ca23fd2d0) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait at ./condition.jl:136 [inlined] From worker 10: #start_gc_msgs_task##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:281 [inlined] From worker 10: lock at ./lock.jl:335 From worker 10: lock at ./condition.jl:80 [inlined] From worker 10: #start_gc_msgs_task##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:279 From worker 10: unknown function (ip: 0x792cbb30ec0f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 2 From worker 10: ---- Task 3 (0x792ca3f41b40) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:699 From worker 10: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:153 [inlined] From worker 10: #26 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:256 From worker 10: unknown function (ip: 0x792cbb312f0f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 3 From worker 10: ---- Task 4 (0x792ca5f24a60) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait_readnb at ./stream.jl:392 From worker 10: wait_locked at ./stream.jl:982 From worker 10: unsafe_read at ./stream.jl:988 From worker 10: unsafe_read at ./io.jl:890 [inlined] From worker 10: unsafe_read at ./io.jl:889 From worker 10: read! at ./io.jl:894 [inlined] From worker 10: deserialize_hdr_raw at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:167 [inlined] From worker 10: message_handler_loop at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:172 From worker 10: process_tcp_streams at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:133 From worker 10: #process_messages##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:121 From worker 10: unknown function (ip: 0x792cbb322f45) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 4 From worker 10: ---- Task 5 (0x792ca2c27a30) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait at ./condition.jl:136 [inlined] From worker 10: _wait at ./task.jl:312 From worker 10: #wait#582 at ./task.jl:361 [inlined] From worker 10: wait at ./task.jl:360 [inlined] From worker 10: fetch at ./task.jl:554 [inlined] From worker 10: #maptwice##0 at ./asyncmap.jl:173 From worker 10: unknown function (ip: 0x792cbb37f642) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: foreach at ./abstractarray.jl:3188 From worker 10: maptwice at ./asyncmap.jl:173 From worker 10: asyncmap at ./asyncmap.jl:76 From worker 10: unknown function (ip: 0x792cbb371f16) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 10: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 10: unknown function (ip: 0x792cbb37073f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: unknown function (ip: 0x792cbb3703fb) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 10: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 10: unknown function (ip: 0x792cbb36ff9f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 5 From worker 10: ---- Task 6 (0x792ca2c27d00) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: fetch_buffered at ./channels.jl:481 From worker 10: fetch at ./channels.jl:480 From worker 10: unknown function (ip: 0x792cbb341942) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 10: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 10: unknown function (ip: 0x792cbb3730f9) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 10: unknown function (ip: 0x792cbb3728f7) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 6 From worker 10: ---- Task 7 (0x792c92095a50) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait at ./condition.jl:136 [inlined] From worker 10: _wait at ./task.jl:312 From worker 10: #wait#582 at ./task.jl:361 [inlined] From worker 10: wait at ./task.jl:360 [inlined] From worker 10: fetch at ./task.jl:554 [inlined] From worker 10: #maptwice##0 at ./asyncmap.jl:173 From worker 10: unknown function (ip: 0x792cbb37f642) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: foreach at ./abstractarray.jl:3188 From worker 10: maptwice at ./asyncmap.jl:173 From worker 10: asyncmap at ./asyncmap.jl:76 From worker 10: unknown function (ip: 0x792cbb373ab6) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 10: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 10: unknown function (ip: 0x792cbb37073f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: unknown function (ip: 0x792cbb3703fb) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 10: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 10: unknown function (ip: 0x792cbb36ff9f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 7 From worker 10: ---- Task 8 (0x792c92095c30) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: fetch_buffered at ./channels.jl:481 From worker 10: fetch at ./channels.jl:480 From worker 10: unknown function (ip: 0x792cbb341942) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 10: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 10: unknown function (ip: 0x792cbb3730f9) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 10: unknown function (ip: 0x792cbb3728f7) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 8 From worker 10: ---- Task 9 (0x792c8741a0e0) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: take_buffered at ./channels.jl:527 From worker 10: take! at ./channels.jl:526 From worker 10: unknown function (ip: 0x792cbb386e02) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 10: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 10: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 10: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 10: unknown function (ip: 0x792cbb378b92) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 10: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 10: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 10: #938 at ./asyncmap.jl:96 From worker 10: unknown function (ip: 0x792cbb378166) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 10: unknown function (ip: 0x792cbb373f2f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 9 From worker 10: ---- Task 109 (0x792c8649a590) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: take_buffered at ./channels.jl:527 From worker 10: take! at ./channels.jl:526 From worker 10: unknown function (ip: 0x792cbb386e02) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 10: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 10: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 10: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 10: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 10: unknown function (ip: 0x792cbb378b92) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 10: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:295 [inlined] From worker 10: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 10: #938 at ./asyncmap.jl:96 From worker 10: unknown function (ip: 0x792cbb380136) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 10: unknown function (ip: 0x792cbb373f2f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 109 From worker 10: ---- Task 209 (0x792ca3430c40) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_swap_fiber at /source/src/task.c:1348 From worker 10: ctx_switch at /source/src/task.c:587 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait at ./condition.jl:136 [inlined] From worker 10: _wait at ./task.jl:312 From worker 10: #wait#582 at ./task.jl:361 [inlined] From worker 10: wait at ./task.jl:360 [inlined] From worker 10: fetch at ./task.jl:554 [inlined] From worker 10: #maptwice##0 at ./asyncmap.jl:173 From worker 10: unknown function (ip: 0x792cbb37f642) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: foreach at ./abstractarray.jl:3188 From worker 10: maptwice at ./asyncmap.jl:173 From worker 10: wrap_n_exec_twice at ./asyncmap.jl:149 [inlined] From worker 10: #async_usemap#924 at ./asyncmap.jl:99 [inlined] From worker 10: async_usemap at ./asyncmap.jl:80 [inlined] From worker 10: #asyncmap#923 at ./asyncmap.jl:77 [inlined] From worker 10: asyncmap at ./asyncmap.jl:76 From worker 10: unknown function (ip: 0x792cbb382182) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 10: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 10: unknown function (ip: 0x792cbb37073f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: unknown function (ip: 0x792cbb3703fb) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 10: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 10: unknown function (ip: 0x792cbb36ff9f) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 209 From worker 10: ---- Task 210 (0x792ca3430e20) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: fetch_buffered at ./channels.jl:481 From worker 10: fetch at ./channels.jl:480 From worker 10: unknown function (ip: 0x792cbb341942) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 10: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 10: unknown function (ip: 0x792cbb3730f9) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 10: unknown function (ip: 0x792cbb3728f7) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 210 From worker 10: ---- Task 211 (0x792ca3431000) From worker 10: (sticky: 1, started: 1, state: 0, tid: 1) From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: #wait#398 at ./condition.jl:141 From worker 10: wait at ./condition.jl:136 [inlined] From worker 10: _wait at ./task.jl:312 From worker 10: #start_profile_listener##2 at ./Base.jl:359 From worker 10: jfptr_YY.start_profile_listenerYY.YY.2_16938.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: _atexit at ./initdefs.jl:464 From worker 10: unknown function (ip: 0x792cbb382ed4) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: ijl_atexit_hook at /source/src/init.c:260 From worker 10: ijl_exit at /source/src/init.c:196 From worker 10: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 10: exit at ./initdefs.jl:28 From worker 10: exit at ./initdefs.jl:29 From worker 10: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f_invokelatest at /source/src/builtins.c:881 From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 10: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 10: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 10: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 10: unknown function (ip: 0x792cbb33e0bf) at (unknown file) From worker 10: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 10: ijl_apply_generic at /source/src/gf.c:4210 From worker 10: jl_apply at /source/src/julia.h:2391 [inlined] From worker 10: start_task at /source/src/task.c:1252 From worker 10: ---- End task 211 From worker 10: ==== End thread 1 From worker 10: ==== Done From worker 10: in expression starting at none:0 From worker 10: jl_start_fiber_swap at /source/src/task.c:1438 From worker 10: ctx_switch at /source/src/task.c:650 From worker 10: ijl_switch at /source/src/task.c:690 From worker 10: try_yieldto at ./task.jl:1143 From worker 10: wait at ./task.jl:1229 From worker 10: Allocations: 10505987 (Pool: 10505939; Big: 48); GC: 7 ┌ Warning: Worker 10 ignored SIGQUIT, sending SIGKILL └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:765 [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 12: From worker 12: ====================================================================================== From worker 12: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 12: ====================================================================================== From worker 12: From worker 12: cmd: /opt/julia/bin/julia 67 running 1 of 1 From worker 12: From worker 12: signal (10): User defined signal 1 From worker 12: abstract_apply at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1874 From worker 12: abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2649 From worker 12: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2890 From worker 12: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2883 [inlined] From worker 12: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3043 From worker 12: abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3386 From worker 12: abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3836 [inlined] From worker 12: abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3793 [inlined] From worker 12: typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4343 From worker 12: jfptr_typeinf_local_83491.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4501 From worker 12: typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1254 From worker 12: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1437 [inlined] From worker 12: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1446 From worker 12: jfptr_typeinf_ext_toplevel_80948.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: jl_apply at /source/src/julia.h:2391 [inlined] From worker 12: jl_type_infer at /source/src/gf.c:462 From worker 12: jl_compile_method_internal at /source/src/gf.c:3512 From worker 12: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 12: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 12: unknown function (ip: 0x7a0d041774bf) at (unknown file) From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: jl_apply at /source/src/julia.h:2391 [inlined] From worker 12: jl_f_invokelatest at /source/src/builtins.c:881 From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: jl_apply at /source/src/julia.h:2391 [inlined] From worker 12: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 12: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 12: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 12: unknown function (ip: 0x7a0d0416f05b) at (unknown file) From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 12: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 12: unknown function (ip: 0x7a0d0416ebff) at (unknown file) From worker 12: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 12: ijl_apply_generic at /source/src/gf.c:4210 From worker 12: jl_apply at /source/src/julia.h:2391 [inlined] From worker 12: start_task at /source/src/task.c:1252 From worker 12: unknown function (ip: (nil)) at (unknown file) From worker 12: From worker 12: ============================================================== From worker 12: Profile collected. A report will print at the next yield point From worker 12: ============================================================== From worker 12: [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 ┌ Warning: Sending SIGQUIT to worker 12 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 14: From worker 14: ====================================================================================== From worker 14: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 14: ====================================================================================== From worker 14: From worker 14: cmd: /opt/julia/bin/julia 75 running 1 of 1 From worker 14: From worker 14: signal (10): User defined signal 1 From worker 14: _ZN12_GLOBAL__N_111DAGCombiner10visitSTOREEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN12_GLOBAL__N_111DAGCombiner7combineEPN4llvm6SDNodeE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN12_GLOBAL__N_111DAGCombiner3RunEN4llvm12CombineLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm12SelectionDAG7CombineENS_12CombineLevelEPNS_9AAResultsENS_15CodeGenOptLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm16SelectionDAGISel17CodeGenAndEmitDAGEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm16SelectionDAGISel20SelectAllBasicBlocksERKNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm16SelectionDAGISel20runOnMachineFunctionERNS_15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN12_GLOBAL__N_115X86DAGToDAGISel20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 14: operator() at /source/src/jitlayers.cpp:1561 From worker 14: addModule at /source/src/jitlayers.cpp:2044 From worker 14: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 14: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 14: jl_compile_method_internal at /source/src/gf.c:3524 From worker 14: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: serialize_msg at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:78 From worker 14: unknown function (ip: 0x75ff288e79e6) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: send_msg_ at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:181 From worker 14: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 14: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 14: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 14: unknown function (ip: 0x75ff288e6b32) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 14: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 14: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 14: #938 at ./asyncmap.jl:96 From worker 14: unknown function (ip: 0x75ff288e6856) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 14: unknown function (ip: 0x75ff288e1f4f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: unknown function (ip: (nil)) at (unknown file) From worker 14: From worker 14: ============================================================== From worker 14: Profile collected. A report will print at the next yield point From worker 14: ============================================================== From worker 14: [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. From worker 14: ┌ Warning: There were no samples collected in one or more groups. From worker 14: │ This may be due to idle threads, or you may need to run your From worker 14: │ program longer (perhaps by running it multiple times), From worker 14: │ or adjust the delay between samples with `Profile.init()`. From worker 14: └ @ Profile /opt/julia/share/julia/stdlib/v1.12/Profile/src/Profile.jl:1361 From worker 14: Overhead ╎ [+additional indent] Count File:Line Function From worker 14: ========================================================= From worker 14: Thread 1 (default) Task 0x000075fef4836860 Total snapshots: 59. Utilization: 100% From worker 14: ╎49 @Base/asyncmap.jl:230 (::Base.var"#start_worker_task!##0#start_worker_ta… From worker 14: ╎ 49 @Base/asyncmap.jl:96 (::Base.var"#938#939"{Dispatcher.var"#run!##0#run!… From worker 14: ╎ 49 @Dispatcher/…c/nodes.jl:324 (::Dispatcher.var"#run!##0#run!##1")(node:… From worker 14: ╎ 49 @Dispatcher/…c/nodes.jl:407 fetch From worker 14: ╎ 49 @DeferredFutures/…s.jl:226 fetch(ref::DeferredFutures.DeferredFuture) From worker 14: ╎ 49 @Distributed/…ecall.jl:656 fetch(::RemoteChannel{Channel{Any}}) From worker 14: ╎ ╎ 49 @Distributed/…ecall.jl:565 call_on_owner From worker 14: ╎ ╎ 49 @Distributed/…call.jl:492 remotecall_fetch From worker 14: ╎ ╎ 49 @Distributed/…call.jl:492 #remotecall_fetch#113 From worker 14: ╎ ╎ 49 @Distributed/…all.jl:454 remotecall_fetch(f::Function, w::Distr… From worker 14: ╎ ╎ 49 @Distributed/…all.jl:454 remotecall_fetch(f::Function, w::Dist… From worker 14: ╎ ╎ ╎ 49 @Distributed/…ges.jl:181 send_msg_(w::Distributed.Worker, hea… From worker 14: 48╎ ╎ ╎ 49 @Distributed/…ges.jl:78 serialize_msg(s::Distributed.Cluster… From worker 14: ┌ Warning: Sending SIGQUIT to worker 14 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 From worker 14: From worker 14: [75] signal 3: Quit From worker 14: ==== Thread 1 created 314 live tasks From worker 14: ---- Root task (0x75ff0f9fc010) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #start_worker#24 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:276 From worker 14: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:237 From worker 14: unknown function (ip: 0x75ff2887da66) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: #start_worker#23 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 14: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 14: start_worker at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:236 From worker 14: process_opts at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:1387 From worker 14: unknown function (ip: 0x75ff288723f2) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: exec_options at ./client.jl:263 From worker 14: _start at ./client.jl:550 From worker 14: jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: true_main at /source/src/jlapi.c:971 From worker 14: jl_repl_entrypoint at /source/src/jlapi.c:1139 From worker 14: main at /source/cli/loader_exe.c:58 From worker 14: unknown function (ip: 0x75ff29df9249) at /lib/x86_64-linux-gnu/libc.so.6 From worker 14: __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) From worker 14: unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S From worker 14: ---- End root task From worker 14: ---- Task 2 (0x75ff0f9fd2d0) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: wait at ./condition.jl:136 [inlined] From worker 14: #start_gc_msgs_task##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:281 [inlined] From worker 14: lock at ./lock.jl:335 From worker 14: lock at ./condition.jl:80 [inlined] From worker 14: #start_gc_msgs_task##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:279 From worker 14: unknown function (ip: 0x75ff2887cbff) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 2 From worker 14: ---- Task 3 (0x75ff11535d20) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:699 From worker 14: accept at /source/usr/share/julia/stdlib/v1.12/Sockets/src/Sockets.jl:153 [inlined] From worker 14: #26 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/cluster.jl:256 From worker 14: unknown function (ip: 0x75ff28880eff) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 3 From worker 14: ---- Task 4 (0x75ff13524c40) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: wait_readnb at ./stream.jl:392 From worker 14: wait_locked at ./stream.jl:982 From worker 14: unsafe_read at ./stream.jl:988 From worker 14: unsafe_read at ./io.jl:890 [inlined] From worker 14: unsafe_read at ./io.jl:889 From worker 14: read! at ./io.jl:894 [inlined] From worker 14: deserialize_hdr_raw at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:167 [inlined] From worker 14: message_handler_loop at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:172 From worker 14: process_tcp_streams at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:133 From worker 14: #process_messages##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:121 From worker 14: unknown function (ip: 0x75ff28890a45) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 4 From worker 14: ---- Task 5 (0x75feff7b03d0) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: wait at ./condition.jl:136 [inlined] From worker 14: _wait at ./task.jl:312 From worker 14: #wait#582 at ./task.jl:361 [inlined] From worker 14: wait at ./task.jl:360 [inlined] From worker 14: fetch at ./task.jl:554 [inlined] From worker 14: #maptwice##0 at ./asyncmap.jl:173 From worker 14: unknown function (ip: 0x75ff288ed662) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: foreach at ./abstractarray.jl:3188 From worker 14: maptwice at ./asyncmap.jl:173 From worker 14: asyncmap at ./asyncmap.jl:76 From worker 14: unknown function (ip: 0x75ff288dfad6) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 14: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 14: unknown function (ip: 0x75ff288de75f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: unknown function (ip: 0x75ff288de70b) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 14: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 14: unknown function (ip: 0x75ff288ddfbf) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 5 From worker 14: ---- Task 6 (0x75feff7b06a0) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: fetch_buffered at ./channels.jl:481 From worker 14: fetch at ./channels.jl:480 From worker 14: unknown function (ip: 0x75ff288afa42) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 14: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 14: unknown function (ip: 0x75ff288e1119) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 14: unknown function (ip: 0x75ff288e0c07) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 6 From worker 14: ---- Task 7 (0x75feff7b23b0) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: wait at ./condition.jl:136 [inlined] From worker 14: _wait at ./task.jl:312 From worker 14: #wait#582 at ./task.jl:361 [inlined] From worker 14: wait at ./task.jl:360 [inlined] From worker 14: fetch at ./task.jl:554 [inlined] From worker 14: #maptwice##0 at ./asyncmap.jl:173 From worker 14: unknown function (ip: 0x75ff288ed662) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: foreach at ./abstractarray.jl:3188 From worker 14: maptwice at ./asyncmap.jl:173 From worker 14: asyncmap at ./asyncmap.jl:76 From worker 14: unknown function (ip: 0x75ff288e1636) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:322 From worker 14: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 14: unknown function (ip: 0x75ff288de75f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: unknown function (ip: 0x75ff288de70b) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 14: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 14: unknown function (ip: 0x75ff288ddfbf) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 7 From worker 14: ---- Task 8 (0x75fef4836860) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: take_buffered at ./channels.jl:527 From worker 14: take! at ./channels.jl:526 From worker 14: unknown function (ip: 0x75ff288f4e22) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 14: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 14: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 14: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 14: unknown function (ip: 0x75ff288e6b32) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 14: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 14: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 14: #938 at ./asyncmap.jl:96 From worker 14: unknown function (ip: 0x75ff288e6856) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 14: unknown function (ip: 0x75ff288e1f4f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 8 From worker 14: ---- Task 108 (0x75feffcd81f0) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: take_buffered at ./channels.jl:527 From worker 14: take! at ./channels.jl:526 From worker 14: unknown function (ip: 0x75ff288f4e22) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: take! at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:726 From worker 14: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:461 From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 14: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 14: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 14: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 14: unknown function (ip: 0x75ff288e6b32) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 14: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:295 [inlined] From worker 14: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 14: #938 at ./asyncmap.jl:96 From worker 14: unknown function (ip: 0x75ff288ede76) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 14: unknown function (ip: 0x75ff288e1f4f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 108 From worker 14: ---- Task 208 (0x75ff10ac2860) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: fetch_buffered at ./channels.jl:481 From worker 14: fetch at ./channels.jl:480 From worker 14: unknown function (ip: 0x75ff288afa42) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 14: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 14: unknown function (ip: 0x75ff288e1119) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 14: unknown function (ip: 0x75ff288e0c07) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 208 From worker 14: ---- Task 209 (0x75ff10ac2a40) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_swap_fiber at /source/src/task.c:1348 From worker 14: ctx_switch at /source/src/task.c:587 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: _trywait at ./asyncevent.jl:163 From worker 14: wait at ./asyncevent.jl:202 [inlined] From worker 14: sleep at ./asyncevent.jl:312 [inlined] From worker 14: rand_sleep at ./none (unknown line) [inlined] From worker 14: rand_sleep at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:0 From worker 14: #130 at ./none (unknown line) [inlined] From worker 14: #130 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:0 From worker 14: unknown function (ip: 0x75ff288fe50f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: run! at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:343 From worker 14: #dispatch!##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/macros.jl:43 From worker 14: unknown function (ip: 0x75ff288de75f) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##0 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:283 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: unknown function (ip: 0x75ff288de70b) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 14: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 14: unknown function (ip: 0x75ff288ddfbf) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 209 From worker 14: ---- Task 210 (0x75ff10ac2c20) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_start_fiber_swap at /source/src/task.c:1438 From worker 14: ctx_switch at /source/src/task.c:650 From worker 14: ijl_switch at /source/src/task.c:690 From worker 14: try_yieldto at ./task.jl:1143 From worker 14: wait at ./task.jl:1229 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: fetch_buffered at ./channels.jl:481 From worker 14: fetch at ./channels.jl:480 From worker 14: unknown function (ip: 0x75ff288afa42) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 14: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 14: unknown function (ip: 0x75ff288e1119) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 14: unknown function (ip: 0x75ff288e0c07) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: ---- End task 210 From worker 14: ---- Task 211 (0x75ff10ac2e00) From worker 14: (sticky: 1, started: 1, state: 0, tid: 1) From worker 14: jl_record_backtrace at /source/src/stackwalk.c:1299 From worker 14: jlbacktracet at /source/src/stackwalk.c:1398 From worker 14: jl_print_task_backtraces at /source/src/stackwalk.c:1458 From worker 14: jl_critical_error at /source/src/signal-handling.c:640 From worker 14: jl_exit_thread0_cb at /source/src/signals-unix.c:563 From worker 14: ---- End task 211 From worker 14: ==== End thread 1 From worker 14: ==== Done From worker 14: in expression starting at none:0 From worker 14: jl_record_backtrace at /source/src/stackwalk.c:1299 From worker 14: jlbacktracet at /source/src/stackwalk.c:1398 From worker 14: jl_print_task_backtraces at /source/src/stackwalk.c:1458 From worker 14: jl_critical_error at /source/src/signal-handling.c:640 From worker 14: jl_exit_thread0_cb at /source/src/signals-unix.c:563 From worker 14: #wait#398 at ./condition.jl:141 From worker 14: fetch_buffered at ./channels.jl:481 From worker 14: fetch at ./channels.jl:480 From worker 14: unknown function (ip: 0x75ff288afa42) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: fetch_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:648 From worker 14: wait_ref at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:570 From worker 14: unknown function (ip: 0x75ff288e1119) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f_invokelatest at /source/src/builtins.c:881 From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 14: #handle_msg##4 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:287 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 14: #handle_msg##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:286 From worker 14: unknown function (ip: 0x75ff288e0c07) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:79 From worker 14: #schedule_call##2 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:88 From worker 14: unknown function (ip: 0x75ff288ddfbf) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: unknown function (ip: 0x75ff288ddfbf) at (unknown file) From worker 14: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 14: ijl_apply_generic at /source/src/gf.c:4210 From worker 14: jl_apply at /source/src/julia.h:2391 [inlined] From worker 14: start_task at /source/src/task.c:1252 From worker 14: Allocations: 10416599 (Pool: 10416551; Big: 48); GC: 7 [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 16 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 16 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 16: From worker 16: ====================================================================================== From worker 16: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 16: ====================================================================================== From worker 16: From worker 16: cmd: /opt/julia/bin/julia 83 running 1 of 1 From worker 16: From worker 16: signal (10): User defined signal 1 From worker 16: _ZN4llvm13PMDataManager23verifyPreservedAnalysisEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 16: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 16: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 16: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 16: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 16: operator() at /source/src/jitlayers.cpp:1561 From worker 16: addModule at /source/src/jitlayers.cpp:2044 From worker 16: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 16: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 16: jl_compile_method_internal at /source/src/gf.c:3524 From worker 16: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 16: ijl_apply_generic at /source/src/gf.c:4210 From worker 16: summary at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:229 From worker 16: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:323 From worker 16: #938 at ./asyncmap.jl:96 From worker 16: unknown function (ip: 0x7670e857d8e6) at (unknown file) From worker 16: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 16: ijl_apply_generic at /source/src/gf.c:4210 From worker 16: jl_apply at /source/src/julia.h:2391 [inlined] From worker 16: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 16: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 16: unknown function (ip: 0x7670e8579f5f) at (unknown file) From worker 16: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 16: ijl_apply_generic at /source/src/gf.c:4210 From worker 16: jl_apply at /source/src/julia.h:2391 [inlined] From worker 16: start_task at /source/src/task.c:1252 From worker 16: unknown function (ip: (nil)) at (unknown file) From worker 16: From worker 16: ============================================================== From worker 16: Profile collected. A report will print at the next yield point From worker 16: ============================================================== From worker 16: [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. ┌ Warning: Sending SIGQUIT to worker 16 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 19: From worker 19: ====================================================================================== From worker 19: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 19: ====================================================================================== From worker 18: From worker 18: ====================================================================================== From worker 18: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 18: ====================================================================================== From worker 19: From worker 19: cmd: /opt/julia/bin/julia 93 running 1 of 1 From worker 19: From worker 19: signal (10): User defined signal 1 From worker 19: _ZNSt8_Rb_treeIjSt4pairIKjPN4llvm14MachineOperandEESt10_Select1stIS5_ESt4lessIjESaIS5_EE5eraseERS1_ at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 19: unknown function (ip: 0x7e88a7c085a5) at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl From worker 19: unknown function (ip: 0x4ffffffff) at (unknown file) From worker 19: unknown function (ip: (nil)) at (unknown file) From worker 18: From worker 18: cmd: /opt/julia/bin/julia 91 running 1 of 1 From worker 18: From worker 18: signal (10): User defined signal 1 From worker 18: _ZN12_GLOBAL__N_111DAGCombiner3RunEN4llvm12CombineLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm12SelectionDAG7CombineENS_12CombineLevelEPNS_9AAResultsENS_15CodeGenOptLevelE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm16SelectionDAGISel17CodeGenAndEmitDAGEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm16SelectionDAGISel20SelectAllBasicBlocksERKNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm16SelectionDAGISel20runOnMachineFunctionERNS_15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN12_GLOBAL__N_115X86DAGToDAGISel20runOnMachineFunctionERN4llvm15MachineFunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 18: operator() at /source/src/jitlayers.cpp:1561 From worker 18: addModule at /source/src/jitlayers.cpp:2044 From worker 18: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 18: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 18: jl_compile_method_internal at /source/src/gf.c:3524 From worker 18: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4210 From worker 18: jl_apply at /source/src/julia.h:2391 [inlined] From worker 18: ijl_atexit_hook at /source/src/init.c:260 From worker 18: ijl_exit at /source/src/init.c:196 From worker 18: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line)[info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. From worker 18: exit at ./initdefs.jl:28 From worker 18: exit at ./initdefs.jl:29 [info | Dispatcher]: Node 4 (Op, Op<4>>): running. From worker 18: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 18: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4210 From worker 18: jl_apply at /source/src/julia.h:2391 [inlined] From worker 18: jl_f_invokelatest at /source/src/builtins.c:881 From worker 18: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4210 From worker 18: jl_apply at /source/src/julia.h:2391 [inlined] From worker 18: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 18: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 18: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 18: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 18: unknown function (ip: 0x7dd90173d85f) at (unknown file) From worker 18: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 18: ijl_apply_generic at /source/src/gf.c:4210 From worker 18: jl_apply at /source/src/julia.h:2391 [inlined] From worker 18: start_task at /source/src/task.c:1252 From worker 18: unknown function (ip: (nil)) at (unknown file) From worker 18: From worker 18: ============================================================== From worker 18: Profile collected. A report will print at the next yield point From worker 18: ============================================================== From worker 18: ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 18 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 19 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 20: From worker 20: ====================================================================================== From worker 20: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 20: ====================================================================================== From worker 21: From worker 21: ====================================================================================== From worker 21: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 21: ====================================================================================== From worker 21: From worker 21: cmd: /opt/julia/bin/julia 101 running 1 of 1 From worker 21: From worker 21: signal (10): User defined signal 1 From worker 21: _ZN4llvm17ScheduleDAGInstrs14addPhysRegDepsEPNS_5SUnitEj at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm17ScheduleDAGInstrs15buildSchedGraphEPNS_9AAResultsEPNS_18RegPressureTrackerEPNS_13PressureDiffsEPNS_13LiveIntervalsEb at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: From worker 20: cmd: /opt/julia/bin/julia 99 running 1 of 1 From worker 20: From worker 20: signal (10): User defined signal 1 From worker 21: _ZN12_GLOBAL__N_120SchedulePostRATDList8scheduleEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm13SmallDenseMapIN15LiveDebugValues6LocIdxENS1_10ValueIDNumELj4ENS_12DenseMapInfoIS2_vEENS_6detail12DenseMapPairIS2_S3_EEE4growEj at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN12_GLOBAL__N_115PostRAScheduler20runOnMachineFunctionERN4llvm15MachineFunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN15LiveDebugValues16InstrRefBasedLDV27produceMLocTransferFunctionERN4llvm15MachineFunctionERNS1_15SmallVectorImplINS1_13SmallDenseMapINS_6LocIdxENS_10ValueIDNumELj4ENS1_12DenseMapInfoIS6_vEENS1_6detail12DenseMapPairIS6_S7_EEEEEEj at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN15LiveDebugValues16InstrRefBasedLDV12ExtendRangesERN4llvm15MachineFunctionEPNS1_20MachineDominatorTreeEPNS1_16TargetPassConfigEjj at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm19MachineFunctionPass13runOnFunctionERNS_8FunctionE.part.0 at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm13FPPassManager13runOnFunctionERNS_8FunctionE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm13FPPassManager11runOnModuleERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm6legacy15PassManagerImpl3runERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 20: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 21: operator() at /source/src/jitlayers.cpp:1561 From worker 21: addModule at /source/src/jitlayers.cpp:2044 From worker 21: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 21: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 20: operator() at /source/src/jitlayers.cpp:1561 From worker 20: addModule at /source/src/jitlayers.cpp:2044 From worker 20: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 20: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 20: jl_compile_method_internal at /source/src/gf.c:3524 From worker 21: jl_compile_method_internal at /source/src/gf.c:3524 From worker 21: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4210 From worker 21: _atexit at ./initdefs.jl:464 From worker 21: unknown function (ip: 0x72b27237f7d4) at (unknown file) From worker 21: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4210 From worker 21: jl_apply at /source/src/julia.h:2391 [inlined] From worker 21: ijl_atexit_hook at /source/src/init.c:260 From worker 21: ijl_exit at /source/src/init.c:196 From worker 20: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4210 From worker 20: jl_apply at /source/src/julia.h:2391 [inlined] From worker 20: ijl_atexit_hook at /source/src/init.c:260 From worker 20: ijl_exit at /source/src/init.c:196 From worker 21: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 21: exit at ./initdefs.jl:28 From worker 21: exit at ./initdefs.jl:29 From worker 21: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 21: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4210 From worker 21: jl_apply at /source/src/julia.h:2391 [inlined] From worker 21: jl_f_invokelatest at /source/src/builtins.c:881 From worker 21: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4210 From worker 21: jl_apply at /source/src/julia.h:2391 [inlined] From worker 21: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 21: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 21: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 21: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 21: unknown function (ip: 0x72b27233dccf) at (unknown file) From worker 21: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 21: ijl_apply_generic at /source/src/gf.c:4210 From worker 20: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 20: exit at ./initdefs.jl:28 From worker 20: exit at ./initdefs.jl:29 From worker 20: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 20: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4210 From worker 20: jl_apply at /source/src/julia.h:2391 [inlined] From worker 20: jl_f_invokelatest at /source/src/builtins.c:881 From worker 20: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4210 From worker 20: jl_apply at /source/src/julia.h:2391 [inlined] From worker 20: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 20: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 20: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 21: jl_apply at /source/src/julia.h:2391 [inlined] From worker 21: start_task at /source/src/task.c:1252 From worker 21: unknown function (ip: (nil)) at (unknown file) From worker 20: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 20: unknown function (ip: 0x7f4f4313dc6f) at (unknown file) From worker 20: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 20: ijl_apply_generic at /source/src/gf.c:4210 From worker 20: jl_apply at /source/src/julia.h:2391 [inlined] From worker 20: start_task at /source/src/task.c:1252 From worker 20: unknown function (ip: (nil)) at (unknown file) From worker 20: From worker 20: ============================================================== From worker 20: Profile collected. A report will print at the next yield point From worker 20: ============================================================== From worker 20: [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 1 (Op, 2>>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 5 (Op<3>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 4 (Op, Op<4>>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 3 (Op>): complete. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 2 (IndexNode, 2>): complete. [info | Dispatcher]: Node 1 (Op, 2>>): complete. [info | Dispatcher]: All 6 nodes executed. ┌ Warning: Sending SIGQUIT to worker 20 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 21 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [info | Dispatcher]: Executing 6 graph nodes. [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. [info | Dispatcher]: Node 3 (Op>): running. [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 5 (Op<3>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. ┌ Warning: Failed to gracefully kill worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 ┌ Warning: Failed to gracefully kill worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:753 ┌ Warning: Sending profile SIGUSR1 to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:756 From worker 22: From worker 22: ====================================================================================== From worker 22: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 22: ====================================================================================== From worker 23: From worker 23: ====================================================================================== From worker 23: Information request received. A stacktrace will print followed by a 1.0 second profile From worker 23: ====================================================================================== From worker 23: From worker 23: cmd: /opt/julia/bin/julia 109 running 1 of 1 From worker 23: From worker 23: signal (10): User defined signal 1 From worker 22: From worker 22: cmd: /opt/julia/bin/julia 107 running 1 of 1 From worker 22: From worker 22: signal (10): User defined signal 1 From worker 22: pthread_once at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) From worker 22: _ZN4llvm15callDefaultCtorINS_19ReachingDefAnalysisELb1EEEPNS_4PassEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN4llvm17PMTopLevelManager12schedulePassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN4llvm16TargetPassConfig7addPassEPNS_4PassE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN12_GLOBAL__N_113X86PassConfig14addPreEmitPassEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN4llvm16TargetPassConfig16addMachinePassesEv at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZL23addPassesToGenerateCodeRN4llvm17LLVMTargetMachineERNS_6legacy15PassManagerBaseEbRNS_28MachineModuleInfoWrapperPassE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN4llvm17LLVMTargetMachine17addPassesToEmitMCERNS_6legacy15PassManagerBaseERPNS_9MCContextERNS_17raw_pwrite_streamEb at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 22: _ZN4llvm3orc14SimpleCompilerclERNS_6ModuleE at /opt/julia/bin/../lib/julia/libLLVM.so.18.1jl (unknown line) From worker 23: ComputeTryCatch at ./../usr/share/julia/Compiler/src/inferencestate.jl:462 From worker 23: ComputeTryCatch at ./../usr/share/julia/Compiler/src/inferencestate.jl:470 [inlined] From worker 23: InferenceState at ./../usr/share/julia/Compiler/src/inferencestate.jl:338 From worker 23: jfptr_InferenceState_2219.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_invoke at /source/src/gf.c:4017 From worker 23: tojlinvoke85220.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: j_InferenceState_77146.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: InferenceState at ./../usr/share/julia/Compiler/src/inferencestate.jl:605 From worker 23: InferenceState at ./../usr/share/julia/Compiler/src/inferencestate.jl:607 [inlined] From worker 23: const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1343 From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:899 From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 From worker 23: handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:168 From worker 22: operator() at /source/src/jitlayers.cpp:1561 From worker 22: addModule at /source/src/jitlayers.cpp:2044 From worker 22: jl_compile_codeinst_now at /source/src/jitlayers.cpp:626 From worker 22: jl_compile_codeinst_impl at /source/src/jitlayers.cpp:824 From worker 23: infercalls at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:252 From worker 23: abstract_call_gf_by_type at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:338 From worker 23: abstract_call_known at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2783 From worker 23: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2890 From worker 23: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:2883 [inlined] From worker 23: abstract_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3043 From worker 23: abstract_eval_statement_expr at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3386 From worker 22: jl_compile_method_internal at /source/src/gf.c:3524 From worker 22: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4210 From worker 22: serialize_msg at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:78 From worker 22: unknown function (ip: 0x78025ff7a4f6) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3836 [inlined] From worker 23: abstract_eval_basic_statement at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:3793 [inlined] From worker 23: typeinf_local at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4343 From worker 23: jfptr_typeinf_local_83491.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4501 From worker 23: const_prop_call at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:1349 From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:899 From worker 22: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: abstract_call_method_with_const_args at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:868 From worker 23: handle1 at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:168 From worker 23: jfptr_handle1_78097.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: doworkloop at ./../usr/share/julia/Compiler/src/inferencestate.jl:1205 From worker 23: jfptr_doworkloop_82808.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: typeinf at ./../usr/share/julia/Compiler/src/abstractinterpretation.jl:4492 From worker 22: jl_f_invokelatest at /source/src/builtins.c:881 From worker 22: send_msg_ at /source/usr/share/julia/stdlib/v1.12/Distributed/src/messages.jl:181 From worker 22: #remotecall_fetch#109 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 22: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:454 From worker 22: #remotecall_fetch#113 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 22: remotecall_fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:492 [inlined] From worker 23: typeinf_ext at ./../usr/share/julia/Compiler/src/typeinfer.jl:1254 From worker 23: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1437 [inlined] From worker 23: typeinf_ext_toplevel at ./../usr/share/julia/Compiler/src/typeinfer.jl:1446 From worker 23: jfptr_typeinf_ext_toplevel_80948.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: jl_type_infer at /source/src/gf.c:462 From worker 23: jl_compile_method_internal at /source/src/gf.c:3512 From worker 23: _jl_invoke at /source/src/gf.c:4002 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: _atexit at ./initdefs.jl:464 From worker 23: unknown function (ip: 0x7e0dfd77f754) at (unknown file) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: ijl_atexit_hook at /source/src/init.c:260 From worker 23: ijl_exit at /source/src/init.c:196 From worker 23: jlplt_ijl_exit_39548.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 23: exit at ./initdefs.jl:28 From worker 23: exit at ./initdefs.jl:29 From worker 23: jfptr_exit_68806.1 at /opt/julia/lib/julia/sys.so (unknown line) From worker 22: call_on_owner at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:565 [inlined] From worker 22: fetch at /source/usr/share/julia/stdlib/v1.12/Distributed/src/remotecall.jl:656 From worker 22: unknown function (ip: 0x78025ff79dc2) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4210 From worker 22: fetch at /home/pkgeval/.julia/packages/DeferredFutures/TCvh2/src/DeferredFutures.jl:226 From worker 22: fetch at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:407 [inlined] From worker 22: #run!##0 at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/src/nodes.jl:324 From worker 22: #938 at ./asyncmap.jl:96 From worker 22: unknown function (ip: 0x78025ff78e46) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4210 From worker 22: jl_apply at /source/src/julia.h:2391 [inlined] From worker 22: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 22: #start_worker_task!##0 at ./asyncmap.jl:230 From worker 22: unknown function (ip: 0x78025ff7471f) at (unknown file) From worker 22: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 22: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: jl_f_invokelatest at /source/src/builtins.c:881 From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 23: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: jl_f__apply_iterate at /source/src/builtins.c:868 From worker 23: #handle_msg##12 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 23: run_work_thunk at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:70 From worker 23: #handle_msg##10 at /source/usr/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:310 From worker 23: unknown function (ip: 0x7e0dfd73df8f) at (unknown file) From worker 23: _jl_invoke at /source/src/gf.c:4010 [inlined] From worker 23: ijl_apply_generic at /source/src/gf.c:4210 From worker 22: jl_apply at /source/src/julia.h:2391 [inlined] From worker 22: start_task at /source/src/task.c:1252 From worker 22: unknown function (ip: (nil)) at (unknown file) From worker 23: jl_apply at /source/src/julia.h:2391 [inlined] From worker 23: start_task at /source/src/task.c:1252 From worker 23: unknown function (ip: (nil)) at (unknown file) From worker 22: From worker 22: ============================================================== From worker 22: Profile collected. A report will print at the next yield point From worker 22: ============================================================== From worker 22: From worker 23: From worker 23: ============================================================== From worker 23: Profile collected. A report will print at the next yield point From worker 23: ============================================================== From worker 23: [info | Dispatcher]: Node 4 (Op, Op<4>>): running. [info | Dispatcher]: Node 6 (Op<4, Int64>): running. [info | Dispatcher]: Node 2 (IndexNode, 2>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 6 (Op<4, Int64>): complete. From worker 22: ┌ Warning: There were no samples collected in one or more groups. From worker 22: │ This may be due to idle threads, or you may need to run your From worker 22: │ program longer (perhaps by running it multiple times), From worker 22: │ or adjust the delay between samples with `Profile.init()`. From worker 22: └ @ Profile /opt/julia/share/julia/stdlib/v1.12/Profile/src/Profile.jl:1361 From worker 22: Overhead ╎ [+additional indent] Count File:Line Function From worker 22: ========================================================= From worker 22: Thread 1 (default) Task 0x00007802353cd690 Total snapshots: 5. Utilization: 100% From worker 22: 4╎5 @Base/asyncmap.jl:230 (::Base.var"#start_worker_task!##0#start_worker_task… From worker 22: ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [info | Dispatcher]: Node 1 (Op, 2>>): running. [info | Dispatcher]: Node 3 (Op>): running. [notice | Dispatcher]: Handling Error: DependencyError [info | Dispatcher]: Node 5 (Op<3>): running. ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 ┌ Warning: Sending SIGQUIT to worker 22 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 ┌ Warning: Sending SIGQUIT to worker 23 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/managers.jl:760 [notice | Dispatcher]: Handling Error: DependencyError ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [notice | Dispatcher]: Handling Error: DependencyError ┌ Error: Fatal error on process 1 │ exception = │ attempt to send to unknown socket │ Stacktrace: │ [1] error(s::String) │ @ Base ./error.jl:44 │ [2] send_msg_unknown(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:99 │ [3] send_msg_now(s::Sockets.TCPSocket, header::Distributed.MsgHeader, msg::Distributed.ResultMsg) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/messages.jl:115 │ [4] deliver_result(sock::Sockets.TCPSocket, msg::Symbol, oid::Distributed.RRID, value::RemoteChannel{Channel{Any}}) │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:94 │ [5] (::Distributed.var"#handle_msg##2#handle_msg##3"{Distributed.CallMsg{:call_fetch}, Distributed.MsgHeader, Sockets.TCPSocket})() │ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:295 └ @ Distributed /opt/julia/share/julia/stdlib/v1.12/Distributed/src/process_messages.jl:106 [notice | Dispatcher]: Handling Error: DependencyError [notice | Dispatcher]: Handling Error: DependencyError 2 procs removed (delay 0.3): Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:792 Expression: !(resp isa RemoteException) Evaluated: !(RemoteException(1, CapturedException(CapturedException(DependencyError{MethodError}(MethodError(/, (DependencyError{MethodError}(MethodError(getindex, (DependencyError{CapturedException}(CapturedException(DependencyError{CapturedException}(CapturedException(ProcessExitedException(22), Any[(try_yieldto(undo::typeof(Base.ensure_rescheduled)) at task.jl:1157, 1), (wait() at task.jl:1229, 1), (wait(c::Base.GenericCondition{ReentrantLock}; first::Bool) at condition.jl:141, 1), (take_buffered(c::Channel{Any}) at channels.jl:527, 1), (take!(c::Channel{Any}) at channels.jl:526, 1), (take!(::Distributed.RemoteValue) at remotecall.jl:726, 1), (remotecall_fetch(f::Function, w::Distributed.Worker, args::Distributed.RRID; kwargs::Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}) at remotecall.jl:461, 1), (remotecall_fetch(f::Function, w::Distributed.Worker, args::Distributed.RRID) at remotecall.jl:454, 1), (remotecall_fetch at remotecall.jl:492 [inlined], 1), (call_on_owner at remotecall.jl:565 [inlined], 1), (fetch(::RemoteChannel{Channel{Any}}) at remotecall.jl:656, 1), (fetch(ref::DeferredFuture) at DeferredFutures.jl:226, 1), (fetch at nodes.jl:295 [inlined], 1), ((::Dispatcher.var"#run!##0#run!##1")(node::Op) at nodes.jl:324, 1), ((::Base.var"#938#939"{Dispatcher.var"#run!##0#run!##1"})(r::Base.RefValue{Any}, args::Tuple{Op}) at asyncmap.jl:96, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#938#939"{Dispatcher.var"#run!##0#run!##1"}, Channel{Any}, Nothing})() at asyncmap.jl:230, 1)]), Any[((::Base.var"#maptwice##0#maptwice##1")(x::Task) at asyncmap.jl:173, 1), (foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) at abstractarray.jl:3188, 1), (maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op, Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:173, 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op, Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:76, 1), (run!(op::Op) at nodes.jl:322, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), (#local_remotecall_thunk##0 at remotecall.jl:425 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 4), Any[(fetch at nodes.jl:298 [inlined], 1), ((::Dispatcher.var"#run!##0#run!##1")(node::Op) at nodes.jl:324, 1), ((::Base.var"#938#939"{Dispatcher.var"#run!##0#run!##1"})(r::Base.RefValue{Any}, args::Tuple{Op}) at asyncmap.jl:96, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#938#939"{Dispatcher.var"#run!##0#run!##1"}, Channel{Any}, Nothing})() at asyncmap.jl:230, 1)]), Any[((::Base.var"#maptwice##0#maptwice##1")(x::Task) at asyncmap.jl:173, 1), (foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) at abstractarray.jl:3188, 1), (maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:173, 1), (asyncmap(f::Function, c::Base.Iterators.Filter{Dispatcher.var"#dependencies##0#dependencies##1", Base.Iterators.Flatten{Tuple{Tuple{Op}, Base.Generator{Base.Iterators.Zip{Tuple{Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}}, IterTools.var"#imap##0#imap##1"{Dispatcher.var"#dependencies##2#dependencies##3"}}}}}) at asyncmap.jl:76, 1), (run!(op::Op) at nodes.jl:322, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), (#local_remotecall_thunk##0 at remotecall.jl:425 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 3), 2), 0x00000000000097ed), Any[(getindex(r::RemoteChannel{Channel{Any}}, args::Int64) at remotecall.jl:780, 1), (getindex(ref::DeferredFuture, args::Int64) at DeferredFutures.jl:242, 1), (run!(node::IndexNode{Op}) at nodes.jl:442, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}})() at macros.jl:43, 1), (#local_remotecall_thunk##0 at remotecall.jl:425 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{IndexNode{Op}}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 2), 2), 0x00000000000097ed), Any[((::var"#140#141"{var"#rand_sleep#rand_sleep##0", RemoteChannel{Channel{Float64}}})(x::DependencyError{MethodError}) at runtests.jl:780, 1), (run!(op::Op) at nodes.jl:343, 1), ((::Dispatcher.var"#dispatch!##2#dispatch!##3"{Op})() at macros.jl:43, 1), (#local_remotecall_thunk##0 at remotecall.jl:425 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{Dispatcher.var"#dispatch!##2#dispatch!##3"{Op}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)], 1), Any[((::Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph})(err::DependencyError{MethodError}) at executors.jl:282, 1), ((::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}})(x::Int64) at pmap.jl:167, 1), ((::Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}})(r::Base.RefValue{Any}, args::Tuple{Int64}) at asyncmap.jl:96, 1), ((::Base.var"#start_worker_task!##0#start_worker_task!##1"{Base.var"#938#939"{Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}}, Channel{Any}, Nothing})() at asyncmap.jl:230, 1)]), Any[((::Base.var"#maptwice##0#maptwice##1")(x::Task) at asyncmap.jl:173, 1), (foreach(f::Base.var"#maptwice##0#maptwice##1", itr::Vector{Any}) at abstractarray.jl:3188, 1), (maptwice(wrapped_f::Function, chnl::Channel{Any}, worker_tasks::Vector{Any}, c::UnitRange{Int64}) at asyncmap.jl:173, 1), (wrap_n_exec_twice at asyncmap.jl:149 [inlined], 1), (async_usemap(f::Distributed.var"#183#184"{Bool, Base.var"#46#47"{Base.var"#48#49"{ExponentialBackOff, Dispatcher.var"#allow_retry##3#allow_retry##4"{Dispatcher.var"#inner_allow_retry#allow_retry##0"{Vector{Function}}}, Distributed.var"#wrap_retry##0#wrap_retry##1"{Dispatcher.var"#run_inner!#24"{ParallelExecutor, Dispatcher.NodeSet}}}}, Dispatcher.var"#on_error_inner!#25"{Bool, DispatchGraph}}, c::UnitRange{Int64}; ntasks::Int64, batch_size::Nothing) at asyncmap.jl:99, 1), (async_usemap at asyncmap.jl:80 [inlined], 1), (#asyncmap#923 at asyncmap.jl:77 [inlined], 1), (asyncmap at asyncmap.jl:76 [inlined], 1), (dispatch!(exec::ParallelExecutor, graph::DispatchGraph; throw_error::Bool) at executors.jl:349, 1), (dispatch! at executors.jl:244 [inlined], 1), (run!(exec::ParallelExecutor, output_nodes::Vector{Op}, input_nodes::Vector{DispatchNode}; input_map::Dict{DispatchNode, Any}, throw_error::Bool) at executors.jl:103, 1), (run! at executors.jl:81 [inlined], 2), ((::var"#142#143"{Op, ParallelExecutor})() at macros.jl:86, 1), (#local_remotecall_thunk##0 at remotecall.jl:425 [inlined], 1), (run_work_thunk(thunk::Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{var"#142#143"{Op, ParallelExecutor}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}, print_error::Bool) at process_messages.jl:70, 1), (run_work_thunk(rv::Distributed.RemoteValue, thunk::Function) at process_messages.jl:79, 1), ((::Distributed.var"#schedule_call##2#schedule_call##3"{Distributed.RemoteValue, Distributed.var"#local_remotecall_thunk##0#local_remotecall_thunk##1"{var"#142#143"{Op, ParallelExecutor}, Tuple{}, Base.Pairs{Symbol, Union{}, Nothing, @NamedTuple{}}}})() at process_messages.jl:88, 1)])) isa RemoteException) Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:726 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:792 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] 2 procs removed (delay 0.3): Test Failed at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:793 Expression: isready(comm) Stacktrace: [1] top-level scope @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:243 [2] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [3] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:434 [inlined] [4] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [5] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:631 [inlined] [6] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1776 [inlined] [7] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:726 [inlined] [8] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:1865 [inlined] [9] macro expansion @ ~/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:793 [inlined] [10] macro expansion @ /opt/julia/share/julia/stdlib/v1.12/Test/src/Test.jl:680 [inlined] ====================================================================================== Information request received. A stacktrace will print followed by a 1.0 second profile ====================================================================================== cmd: /opt/julia/bin/julia 1 running 0 of 1 signal (10): User defined signal 1 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 wait at ./process.jl:685 wait at ./process.jl:686 jfptr_wait_37520.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 subprocess_handler at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2553 unknown function (ip: 0x757c65d75c43) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 #205 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2493 withenv at ./env.jl:265 #190 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2308 with_temp_env at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2161 #186 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2275 #mktempdir#21 at ./file.jl:936 unknown function (ip: 0x757c65d7399c) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 mktempdir at ./file.jl:932 mktempdir at ./file.jl:932 #sandbox#182 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2222 [inlined] sandbox at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2212 unknown function (ip: 0x757c65d67299) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 #test#193 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2478 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/Operations.jl:2384 [inlined] #test#170 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:538 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:515 unknown function (ip: 0x757c65d667f1) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 #test#84 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:169 unknown function (ip: 0x757c65d5f4d0) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:158 #test#82 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:157 [inlined] #test#81 at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 [inlined] test at /source/usr/share/julia/stdlib/v1.12/Pkg/src/API.jl:156 unknown function (ip: 0x757c65d5c3cf) at (unknown file) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] do_call at /source/src/interpreter.c:123 eval_value at /source/src/interpreter.c:243 eval_stmt_value at /source/src/interpreter.c:194 [inlined] eval_body at /source/src/interpreter.c:689 eval_body at /source/src/interpreter.c:558 eval_body at /source/src/interpreter.c:558 jl_interpret_toplevel_thunk at /source/src/interpreter.c:898 jl_toplevel_eval_flex at /source/src/toplevel.c:1035 jl_toplevel_eval_flex at /source/src/toplevel.c:975 ijl_toplevel_eval at /source/src/toplevel.c:1047 ijl_toplevel_eval_in at /source/src/toplevel.c:1092 eval at ./boot.jl:489 include_string at ./loading.jl:2870 _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 _include at ./loading.jl:2930 include at ./Base.jl:306 exec_options at ./client.jl:317 _start at ./client.jl:550 jfptr__start_39366.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] true_main at /source/src/jlapi.c:971 jl_repl_entrypoint at /source/src/jlapi.c:1139 main at /source/cli/loader_exe.c:58 unknown function (ip: 0x757c81e34249) at /lib/x86_64-linux-gnu/libc.so.6 __libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) unknown function (ip: 0x4010b8) at /workspace/srcdir/glibc-2.17/csu/../sysdeps/x86_64/start.S unknown function (ip: (nil)) at (unknown file) ============================================================== Profile collected. A report will print at the next yield point ============================================================== ┌ Warning: There were no samples collected in one or more groups. │ This may be due to idle threads, or you may need to run your │ program longer (perhaps by running it multiple times), │ or adjust the delay between samples with `Profile.init()`. └ @ Profile /opt/julia/share/julia/stdlib/v1.12/Profile/src/Profile.jl:1361 Overhead ╎ [+additional indent] Count File:Line Function ========================================================= Thread 1 (default) Task 0x0000757c679fc010 Total snapshots: 678. Utilization: 0% ╎678 @Base/client.jl:550 _start() ╎ 678 @Base/client.jl:317 exec_options(opts::Base.JLOptions) ╎ 678 @Base/Base.jl:306 include(mod::Module, _path::String) ╎ 678 @Base/loading.jl:2930 _include(mapexpr::Function, mod::Module, _pat… ╎ 678 @Base/loading.jl:2870 include_string(mapexpr::typeof(identity), mo… ╎ 678 @Base/boot.jl:489 eval(m::Module, e::Any) ╎ ╎ 678 @Pkg/src/API.jl:156 kwcall(::@NamedTuple{julia_args::Cmd}, ::typ… ╎ ╎ 678 @Pkg/src/API.jl:156 #test#81 ╎ ╎ 678 @Pkg/src/API.jl:157 test ╎ ╎ 678 @Pkg/src/API.jl:157 test(pkgs::Vector{String}; kwargs::Base.P… ╎ ╎ 678 @Pkg/src/API.jl:158 kwcall(::@NamedTuple{julia_args::Cmd}, :… ╎ ╎ ╎ 678 @Pkg/src/API.jl:169 test(pkgs::Vector{PackageSpec}; io::IOC… ╎ ╎ ╎ 678 @Pkg/src/API.jl:515 kwcall(::@NamedTuple{julia_args::Cmd, … ╎ ╎ ╎ 678 @Pkg/src/API.jl:538 test(ctx::Pkg.Types.Context, pkgs::Ve… ╎ ╎ ╎ 678 @Pkg/…erations.jl:2384 test ╎ ╎ ╎ 678 @Pkg/…erations.jl:2478 test(ctx::Pkg.Types.Context, pkg… ╎ ╎ ╎ ╎ 678 @Pkg/…rations.jl:2212 kwcall(::@NamedTuple{preferences… ╎ ╎ ╎ ╎ 678 @Pkg/…rations.jl:2222 #sandbox#182 ╎ ╎ ╎ ╎ 678 @Base/file.jl:932 mktempdir(fn::Function) ╎ ╎ ╎ ╎ 678 @Base/file.jl:932 mktempdir(fn::Function, parent::S… ╎ ╎ ╎ ╎ 678 @Base/file.jl:936 mktempdir(fn::Pkg.Operations.var… ╎ ╎ ╎ ╎ ╎ 678 @Pkg/…tions.jl:2275 (::Pkg.Operations.var"#186#18… ╎ ╎ ╎ ╎ ╎ 678 @Pkg/…tions.jl:2161 with_temp_env(fn::Pkg.Operat… ╎ ╎ ╎ ╎ ╎ 678 @Pkg/…tions.jl:2308 (::Pkg.Operations.var"#190#… ╎ ╎ ╎ ╎ ╎ 678 @Base/env.jl:265 withenv(::Pkg.Operations.var"… ╎ ╎ ╎ ╎ ╎ 678 @Pkg/…ions.jl:2493 (::Pkg.Operations.var"#205… ╎ ╎ ╎ ╎ ╎ ╎ 678 @Pkg/…ons.jl:2553 subprocess_handler(cmd::Cm… ╎ ╎ ╎ ╎ ╎ ╎ 678 @Base/…ss.jl:686 wait(x::Base.Process) ╎ ╎ ╎ ╎ ╎ ╎ 678 @Base/…ss.jl:685 wait(x::Base.Process, syn… ╎ ╎ ╎ ╎ ╎ ╎ 678 @Base/…on.jl:141 wait(c::Base.GenericCond… ╎ ╎ ╎ ╎ ╎ ╎ 678 @Base/…sk.jl:1228 wait() 677╎ ╎ ╎ ╎ ╎ ╎ ╎ 678 @Base/…sk.jl:1216 poptask(W::Base.Intru… [1] signal 15: Terminated in expression starting at /PkgEval.jl/scripts/evaluate.jl:214 epoll_pwait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv__io_poll at /workspace/srcdir/libuv/src/unix/linux.c:1404 uv_run at /workspace/srcdir/libuv/src/unix/core.c:430 ijl_task_get_next at /source/src/scheduler.c:457 poptask at ./task.jl:1216 wait at ./task.jl:1228 #wait#398 at ./condition.jl:141 _trywait at ./asyncevent.jl:163 profile_printing_listener at ./Base.jl:332 #start_profile_listener##0 at ./Base.jl:352 jfptr_YY.start_profile_listenerYY.YY.0_9934.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] start_task at /source/src/task.c:1252 unknown function (ip: (nil)) at (unknown file) Allocations: 21927587 (Pool: 21926979; Big: 608); GC: 17 [23] signal 15: Terminated in expression starting at /home/pkgeval/.julia/packages/Dispatcher/JXmtG/test/runtests.jl:242 unknown function (ip: 0x7b8a1c404f14) at /lib/x86_64-linux-gnu/libc.so.6 pthread_cond_wait at /lib/x86_64-linux-gnu/libc.so.6 (unknown line) uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:822 ijl_task_get_next at /source/src/scheduler.c:523 poptask at ./task.jl:1216 wait at ./task.jl:1228 task_done_hook at ./task.jl:868 jfptr_task_done_hook_59255.1 at /opt/julia/lib/julia/sys.so (unknown line) _jl_invoke at /source/src/gf.c:4010 [inlined] ijl_apply_generic at /source/src/gf.c:4210 jl_apply at /source/src/julia.h:2391 [inlined] jl_finish_task at /source/src/task.c:341 start_task at /source/src/task.c:1263 unknown function (ip: (nil)) at (unknown file) Allocations: 35427482 (Pool: 35427175; Big: 307); GC: 25 PkgEval terminated after 1231.79s: tests became inactive