2025.04.04 07:12:22.427117 [ 353 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2025.04.04 07:12:22.427426 [ 353 ] {} KeeperLogStore: Removing all changelogs 2025.04.04 07:12:22.427710 [ 353 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.04 07:12:22.430223 [ 353 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.04 07:12:22.430231 [ 353 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.04 07:12:22.480584 [ 943 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.04 07:12:22.489663 [ 353 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2025.04.04 07:12:22.489680 [ 353 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2025.04.04 07:12:22.498204 [ 353 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.04 07:12:22.498529 [ 353 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.04 07:12:22.883632 [ 360 ] {6553bb45-a538-4bf4-be88-42ddc4875536} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE hits_v1; to attach existing table or CREATE TABLE hits_v1 ; to create new table or ATTACH TABLE hits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2025.04.04 07:12:33.365265 [ 360 ] {dc00c616-37d8-47d6-9ea8-e8d7013277b9} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE visits_v1; to attach existing table or CREATE TABLE visits_v1
; to create new table or ATTACH TABLE visits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2025.04.04 07:13:43.042979 [ 360 ] {980eb638-f2ec-46fe-8065-6a880c8abcdc} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 574.72 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:52598) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:43.043731 [ 360 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 574.72 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:43.204202 [ 360 ] {a103bbd6-e55b-430f-8f9f-cc1262a9d61d} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 574.65 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:52598) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:43.204909 [ 360 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 574.65 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:43.352148 [ 360 ] {838c1b17-b652-4ff3-a3a1-6d9c13c6832a} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.82 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:52598) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits PREWHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:43.352797 [ 360 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.82 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x000000001130452e 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303b93 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:13:52.151858 [ 1790 ] {1d780a71-9cfb-477b-b226-e9f149f2f6d4} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:60746) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117aee20 10. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a78ba 11. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 12. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117bfd0d 13. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a7520 14. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 15. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:4299: DB::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117d8ce7 16. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5563: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x000000001179c45c 17. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001179a82c 18. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001179a100 19. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000011e532d6 20. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) (.llvm.2065071772055247705) @ 0x00000000120af8bd 21. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000120ad81c 22. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::unique_ptr> std::__function::__policy_invoker> (DB::InterpreterFactory::Arguments const&)>::__call_impl> (DB::InterpreterFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::InterpreterFactory::Arguments const&) (.llvm.2065071772055247705) @ 0x00000000120b15c2 23. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001204be6c 24. ./build_docker/./src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242b6bf 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 26. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 27. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 29. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 31. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 2025.04.04 07:13:52.152238 [ 1790 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117aee20 10. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a78ba 11. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 12. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117bfd0d 13. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a7520 14. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 15. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:4299: DB::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117d8ce7 16. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5563: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x000000001179c45c 17. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001179a82c 18. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001179a100 19. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000011e532d6 20. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) (.llvm.2065071772055247705) @ 0x00000000120af8bd 21. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000120ad81c 22. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::unique_ptr> std::__function::__policy_invoker> (DB::InterpreterFactory::Arguments const&)>::__call_impl> (DB::InterpreterFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::InterpreterFactory::Arguments const&) (.llvm.2065071772055247705) @ 0x00000000120b15c2 23. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001204be6c 24. ./build_docker/./src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242b6bf 25. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 26. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 27. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 28. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 29. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 30. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 31. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 2025.04.04 07:13:52.166066 [ 1790 ] {b6627f26-04f8-4178-8f12-3226eba17ecf} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:60746) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242beb5 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 11. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 12. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 14. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 16. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 17. ? @ 0x00007f294c092ac3 18. ? @ 0x00007f294c124850 2025.04.04 07:13:52.166396 [ 1790 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242beb5 10. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 11. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 12. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 13. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 14. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 15. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 16. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 17. ? @ 0x00007f294c092ac3 18. ? @ 0x00007f294c124850 2025.04.04 07:13:52.184808 [ 1790 ] {797b7f8f-d751-4dd6-a13b-483867a42222} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.76 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:60746) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000137b05aa 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:13:52.185250 [ 1790 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.76 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000137b05aa 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:13:52.200143 [ 1790 ] {7554792d-b9f3-4e9c-b132-3556e46bed07} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:60746) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117aee20 10. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a78ba 11. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 12. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117bfd0d 13. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a7520 14. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5588: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x000000001179c65d 15. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001179a82c 16. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001179a100 17. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000011e532d6 18. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) (.llvm.2065071772055247705) @ 0x00000000120af8bd 19. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000120ad81c 20. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::unique_ptr> std::__function::__policy_invoker> (DB::InterpreterFactory::Arguments const&)>::__call_impl> (DB::InterpreterFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::InterpreterFactory::Arguments const&) (.llvm.2065071772055247705) @ 0x00000000120b15c2 21. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001204be6c 22. ./build_docker/./src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242b6bf 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 24. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 25. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 27. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 29. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 30. ? @ 0x00007f294c092ac3 31. ? @ 0x00007f294c124850 2025.04.04 07:13:52.200369 [ 1790 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./src/QueryPipeline/SizeLimits.cpp:72: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013c18634 5. ./build_docker/./src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bca8ea 6. ./build_docker/./src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x0000000013bed319 7. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000120b0f5d 8. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000120b083e 9. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117aee20 10. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a78ba 11. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x00000000117a6000 12. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x00000000117bfd0d 13. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x00000000117a7520 14. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:5588: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x000000001179c65d 15. ./build_docker/./src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x000000001179a82c 16. ./build_docker/./src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x000000001179a100 17. ./build_docker/./src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x0000000011e532d6 18. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) (.llvm.2065071772055247705) @ 0x00000000120af8bd 19. ./build_docker/./src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000120ad81c 20. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::unique_ptr> std::__function::__policy_invoker> (DB::InterpreterFactory::Arguments const&)>::__call_impl> (DB::InterpreterFactory::Arguments const&)>>(std::__function::__policy_storage const*, DB::InterpreterFactory::Arguments const&) (.llvm.2065071772055247705) @ 0x00000000120b15c2 21. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001204be6c 22. ./build_docker/./src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001242b6bf 23. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012426cbd 24. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001370921e 25. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 26. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 27. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 28. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 29. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 30. ? @ 0x00007f294c092ac3 31. ? @ 0x00007f294c124850 2025.04.04 07:13:52.209384 [ 1790 ] {227fb48b-c35e-419d-957a-0164fa152178} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:60746) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000137b05aa 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:13:52.209585 [ 1790 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000137b05aa 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:05.213246 [ 966 ] {da2f855e-10db-45e2-9753-9e5a7fec4167::all_1_7_1} virtual bool DB::MergePlainMergeTreeTask::executeStep(): Exception is in merge_task.: Code: 236. DB::Exception: Cancelled merging parts. (ABORTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x0000000008688b0b 3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:263: DB::MergeTask::GlobalRuntimeContext::checkOperationIsNotCanceled() const @ 0x000000001300aaf7 4. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:931: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() const @ 0x000000001301ee5c 5. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:720: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000001301cd8e 6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:1504: DB::MergeTask::execute() @ 0x0000000013026562 7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001346e8a8 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:308: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001304a2cd 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 11. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 12. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 13. ? @ 0x00007f294c092ac3 14. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:06.565025 [ 975 ] {9d50f6c7-04dc-4b25-8312-35455f7f261b::all_1_6_1} virtual bool DB::MergePlainMergeTreeTask::executeStep(): Exception is in merge_task.: Code: 236. DB::Exception: Cancelled merging parts. (ABORTED), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x0000000008688b0b 3. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:263: DB::MergeTask::GlobalRuntimeContext::checkOperationIsNotCanceled() const @ 0x000000001300aaf7 4. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:931: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() const @ 0x000000001301ee5c 5. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:720: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x000000001301cd8e 6. ./build_docker/./src/Storages/MergeTree/MergeTask.cpp:1504: DB::MergeTask::execute() @ 0x0000000013026562 7. ./build_docker/./src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001346e8a8 8. ./build_docker/./src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:308: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x000000001304a2cd 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 11. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 12. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 13. ? @ 0x00007f294c092ac3 14. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:28.823270 [ 3592 ] {c102f8d1-fa22-4657-bb94-dc836da69ecf} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.65 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41672) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:28.824661 [ 3592 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.65 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:28.829633 [ 2271 ] {d319851a-3dab-4f21-9c87-d46afc7441f3} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49940). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:28.829653 [ 3612 ] {e5030c85-0503-4ae5-935c-f079fe33c646} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:28.829669 [ 1790 ] {25897d4f-c174-400f-8423-28b1ad52ee32} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40156). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:28.830045 [ 3612 ] {e5030c85-0503-4ae5-935c-f079fe33c646} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33278). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33278) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:28.830081 [ 2271 ] {d319851a-3dab-4f21-9c87-d46afc7441f3} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49940). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49940) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:28.830063 [ 1790 ] {25897d4f-c174-400f-8423-28b1ad52ee32} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40156). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40156) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:28.830317 [ 3612 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:28.830423 [ 1790 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40156). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:28.830671 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49940). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.044628 [ 3591 ] {d54309aa-d0dd-45f4-9785-7296c02057f9} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41684) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.045079 [ 2558 ] {a2593079-1a14-4837-ad52-a85548d337df} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50230). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.045257 [ 2271 ] {43f99bec-1315-469e-92d3-bee26a0d387d} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49956). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.045488 [ 1790 ] {8b7074d0-20ee-4d00-b00d-9a12f2542c8b} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33286). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.045549 [ 3612 ] {82839c45-592e-42e9-86d1-e626918609cf} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40158). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.045576 [ 2558 ] {a2593079-1a14-4837-ad52-a85548d337df} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50230). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50230) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.045740 [ 3591 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.045784 [ 2271 ] {43f99bec-1315-469e-92d3-bee26a0d387d} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49956). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49956) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.046020 [ 3612 ] {82839c45-592e-42e9-86d1-e626918609cf} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40158). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40158) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.046028 [ 1790 ] {8b7074d0-20ee-4d00-b00d-9a12f2542c8b} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33286). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33286) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.046773 [ 1790 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33286). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.047112 [ 3612 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40158). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.047389 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50230). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.047527 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49956). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.252154 [ 3612 ] {41eefbb2-a55b-4c8b-8e67-386ed66a49b0} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41690) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.252651 [ 3586 ] {5278199f-e212-48ae-a07f-4c256fa78f60} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59524). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.252676 [ 2243 ] {553ecff3-8e22-4607-9c1e-a4789166a956} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50234). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.252926 [ 2271 ] {37ea2a6f-908b-48da-948b-58c748646748} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33290). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.253272 [ 3612 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.253332 [ 2271 ] {37ea2a6f-908b-48da-948b-58c748646748} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33290). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33290) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.253374 [ 1790 ] {2dd8a1aa-0d27-4c7f-b712-7cc299b59dcc} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40164). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.253531 [ 2558 ] {5aef5570-2a09-4f75-bc31-6851000b6950} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49968). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.253774 [ 1790 ] {2dd8a1aa-0d27-4c7f-b712-7cc299b59dcc} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40164). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40164) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.254161 [ 2243 ] {553ecff3-8e22-4607-9c1e-a4789166a956} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50234). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50234) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.254224 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33290). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.254223 [ 2558 ] {5aef5570-2a09-4f75-bc31-6851000b6950} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49968). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49968) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.254876 [ 3586 ] {5278199f-e212-48ae-a07f-4c256fa78f60} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59524). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59524) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.255209 [ 1790 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40164). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.255308 [ 2243 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50234). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.255316 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49968). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.255722 [ 3586 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59524). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.476831 [ 3612 ] {8954851d-8702-46de-8c4d-2b97be208501} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41706) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.477666 [ 3590 ] {6846bda4-5fd2-4b1f-bcd0-4495d9a516e0} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59532). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.477831 [ 2558 ] {7b2cfabd-d85d-45dc-8847-c99e06e2c221} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50250). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.478010 [ 3586 ] {41c31038-ffc3-4d3c-9e5f-70e13475dfdb} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49980). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.478097 [ 1790 ] {e6f6c561-5e9b-4adb-9289-db982ba356de} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33300). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.478102 [ 3590 ] {6846bda4-5fd2-4b1f-bcd0-4495d9a516e0} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59532). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59532) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.478265 [ 2271 ] {c77a6510-e662-44dd-be23-3aef93ee6df7} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40166). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.478320 [ 2558 ] {7b2cfabd-d85d-45dc-8847-c99e06e2c221} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50250). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50250) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.478552 [ 1790 ] {e6f6c561-5e9b-4adb-9289-db982ba356de} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33300). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33300) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.478627 [ 3612 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.478680 [ 2271 ] {c77a6510-e662-44dd-be23-3aef93ee6df7} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40166). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40166) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.479022 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50250). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.479198 [ 3590 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59532). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.479215 [ 3586 ] {41c31038-ffc3-4d3c-9e5f-70e13475dfdb} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49980). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49980) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.479562 [ 1790 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33300). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.480092 [ 3586 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49980). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.480207 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40166). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.481413 [ 2243 ] {27e938a7-6664-42c9-aac6-72d55ef12d27} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41190). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:41190) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2564: DB::TCPHandler::sendProgress(DB::QueryState&) @ 0x0000000013718899 5. ./build_docker/./src/Server/TCPHandler.cpp:1251: DB::TCPHandler::runImpl() @ 0x0000000013709772 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.482105 [ 2243 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41190). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2564: DB::TCPHandler::sendProgress(DB::QueryState&) @ 0x0000000013718899 5. ./build_docker/./src/Server/TCPHandler.cpp:1251: DB::TCPHandler::runImpl() @ 0x0000000013709772 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.718642 [ 2558 ] {0ece0525-4345-481b-891d-b0ca41af5499} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41712) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.719099 [ 3591 ] {c4a222cd-7020-4c7d-9f62-ebdf76c03fd9} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38336). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.719256 [ 3592 ] {4ff88614-f72d-45dc-927b-999262111542} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41196). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.719619 [ 3592 ] {4ff88614-f72d-45dc-927b-999262111542} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41196). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:41196) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.719652 [ 3588 ] {4731f156-4759-4ac4-8bf7-8e370337f9ba} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50260). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.719914 [ 3590 ] {5a0ee131-3a3a-4964-8997-c55e1087c8ce} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49990). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.720038 [ 3591 ] {c4a222cd-7020-4c7d-9f62-ebdf76c03fd9} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38336). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:38336) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.720582 [ 2558 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.720718 [ 3592 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41196). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.720737 [ 3586 ] {83b3a55c-2b2f-435c-a34f-92d1e092b632} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40178). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.720880 [ 2243 ] {8febeea3-97f3-4088-8c44-6a3a74e82ac4} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33306). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.721031 [ 3591 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38336). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.721165 [ 3586 ] {83b3a55c-2b2f-435c-a34f-92d1e092b632} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40178). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40178) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.721305 [ 3588 ] {4731f156-4759-4ac4-8bf7-8e370337f9ba} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50260). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50260) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.721317 [ 2243 ] {8febeea3-97f3-4088-8c44-6a3a74e82ac4} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33306). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33306) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.721347 [ 3590 ] {5a0ee131-3a3a-4964-8997-c55e1087c8ce} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49990). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49990) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.722285 [ 2243 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33306). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.722515 [ 3590 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49990). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.722543 [ 3586 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40178). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.722589 [ 3588 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50260). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.733782 [ 360 ] {305481b3-49f8-4c46-819f-aa30cb4ffa8c} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59536). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.734170 [ 360 ] {305481b3-49f8-4c46-819f-aa30cb4ffa8c} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59536). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59536) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.735110 [ 360 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59536). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.921631 [ 3589 ] {618adc17-ae7c-4115-ab9e-535624ea1244} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.65 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41728) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.922090 [ 3588 ] {f624af1a-2413-401a-bb3d-6038cd871379} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43168). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.922327 [ 2243 ] {feb48d12-eb78-4bf8-940f-c6ce72e39b8d} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38346). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.922860 [ 2558 ] {891289f8-c524-4049-824f-7cea50c04373} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50274). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.923350 [ 2558 ] {891289f8-c524-4049-824f-7cea50c04373} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50274). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50274) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.922864 [ 2243 ] {feb48d12-eb78-4bf8-940f-c6ce72e39b8d} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38346). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:38346) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.923540 [ 3589 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.65 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:29.923663 [ 1790 ] {29f5fdb7-69d5-48ad-9959-495149721d03} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40194). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.923671 [ 3588 ] {f624af1a-2413-401a-bb3d-6038cd871379} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43168). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:43168) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.923731 [ 3590 ] {a4338571-fa9f-4cb0-b07c-fbd6a39199a3} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41204). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.924316 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50274). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.924446 [ 3588 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43168). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.924600 [ 3590 ] {a4338571-fa9f-4cb0-b07c-fbd6a39199a3} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41204). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:41204) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.924625 [ 2243 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38346). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.925044 [ 1790 ] {29f5fdb7-69d5-48ad-9959-495149721d03} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40194). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40194) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.925151 [ 3590 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41204). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.925748 [ 1790 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40194). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.966460 [ 2271 ] {864c545b-4033-4d96-a100-1a13b9044f99} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33314). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.966860 [ 2271 ] {864c545b-4033-4d96-a100-1a13b9044f99} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33314). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33314) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.967878 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33314). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.977182 [ 3610 ] {fc40d9c3-a9be-4c56-b74c-fbd161f5dc31} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:29.977744 [ 3610 ] {fc40d9c3-a9be-4c56-b74c-fbd161f5dc31} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49992). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49992) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:29.978947 [ 3610 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.146695 [ 3587 ] {fc7a6305-895e-4020-b589-d577a1741acd} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41742) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:30.147469 [ 3589 ] {8b98d773-649c-4186-8bf3-54738bbb46a3} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41220). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.147685 [ 3592 ] {af3e9ba3-5aee-4e21-805c-feedff151c01} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59556). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.147803 [ 360 ] {fbd92152-f471-4179-a66d-5e7a4fa90d37} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.147901 [ 3588 ] {e46eb833-4751-4601-a635-ab4eb4f332ad} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49998). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.148131 [ 2558 ] {884f8be7-3bbd-4c25-8730-1eb23725a8c2} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40204). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.148255 [ 3592 ] {af3e9ba3-5aee-4e21-805c-feedff151c01} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59556). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59556) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.148287 [ 3588 ] {e46eb833-4751-4601-a635-ab4eb4f332ad} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49998). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:49998) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.148293 [ 360 ] {fbd92152-f471-4179-a66d-5e7a4fa90d37} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50278) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.148486 [ 3587 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:30.149031 [ 360 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50278). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.149241 [ 3588 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:49998). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.149263 [ 3592 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59556). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.154936 [ 3589 ] {8b98d773-649c-4186-8bf3-54738bbb46a3} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41220). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:41220) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.156234 [ 3589 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:41220). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.156450 [ 2558 ] {884f8be7-3bbd-4c25-8730-1eb23725a8c2} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40204). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40204) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.157865 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40204). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.185832 [ 3590 ] {cf38835c-9854-4cc5-80a5-9231b05e8ff8} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33326). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.186241 [ 3590 ] {cf38835c-9854-4cc5-80a5-9231b05e8ff8} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33326). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33326) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.187255 [ 3590 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33326). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.196253 [ 1790 ] {860f844d-afa3-4776-9b17-6470aa1fc2e0} TCPHandler: Can't send logs or exception to client. Close connection.: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43182). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:825: DB::TCPHandler::runImpl() @ 0x000000001370a362 5. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 6. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 7. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 8. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 9. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 10. ? @ 0x00007f294c092ac3 11. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.378239 [ 3586 ] {de6fe32c-5cbb-4dd3-9d8e-165a4d8492f3} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:41750) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:30.378943 [ 2271 ] {2b6495d7-020d-4360-a769-e72268877ac4} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38368). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.379328 [ 3588 ] {f5ded6eb-771d-46d3-8b70-8bc9ff6a457a} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59566). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.379536 [ 3587 ] {e14fe57c-a9e2-4624-9e58-58f88d524b62} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33338). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.379584 [ 2271 ] {2b6495d7-020d-4360-a769-e72268877ac4} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38368). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:38368) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.379751 [ 3588 ] {f5ded6eb-771d-46d3-8b70-8bc9ff6a457a} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59566). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59566) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.379804 [ 3610 ] {83c16800-60bb-4fbf-8fc4-353e7ba3ca94} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.379978 [ 3586 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x00000000113040ee 3. ./build_docker/./src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011303d22 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd565 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000137a296e 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86ef9b 9. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d875a62 10. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 11. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 12. ? @ 0x00007f294c092ac3 13. ? @ 0x00007f294c124850 2025.04.04 07:14:30.380206 [ 3610 ] {83c16800-60bb-4fbf-8fc4-353e7ba3ca94} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40216). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:40216) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.380345 [ 3588 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59566). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.380904 [ 3610 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:40216). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.382760 [ 2271 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:38368). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.383327 [ 3587 ] {e14fe57c-a9e2-4624-9e58-58f88d524b62} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33338). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:33338) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.384399 [ 3587 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:33338). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d91233a 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.393139 [ 2558 ] {4d5f8804-4a1d-4ff7-8a87-53041965a6b4} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:50010). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.393625 [ 2558 ] {4d5f8804-4a1d-4ff7-8a87-53041965a6b4} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:50010). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50010) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.394956 [ 2558 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:50010). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.403222 [ 360 ] {92ab5354-d80c-46fa-8206-5eebb13a4022} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43188). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.403635 [ 360 ] {92ab5354-d80c-46fa-8206-5eebb13a4022} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43188). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:43188) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.404636 [ 360 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:43188). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.408167 [ 3590 ] {43a9947f-ba26-496a-b27c-5c96ab7de632} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.408706 [ 3590 ] {43a9947f-ba26-496a-b27c-5c96ab7de632} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50292). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50292) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.409223 [ 3589 ] {8c72d1d5-1129-4aee-b03a-3f871bfcf6c7} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:52718). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 (version 24.12.2.20271.altinityantalya (altinity build)) 2025.04.04 07:14:30.409918 [ 3589 ] {8c72d1d5-1129-4aee-b03a-3f871bfcf6c7} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:52718). (NETWORK_ERROR) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:52718) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.409981 [ 3590 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:50292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:14:30.411053 [ 3589 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:52718). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. ./src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000d9119bf 2. ./build_docker/./src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000d9124ee 3. DB::WriteBuffer::next() @ 0x000000000868963e 4. ./build_docker/./src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x0000000013722368 5. ./build_docker/./src/Server/TCPHandler.cpp:1260: DB::TCPHandler::runImpl() @ 0x00000000137097c2 6. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000013724498 7. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000016639f07 8. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000001663a399 9. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000016606cbc 10. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001660525d 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:20:45.169391 [ 360 ] {a15d42ac-513b-4cff-b691-a7b3b03000a7} executeQuery: Code: 160. DB::Exception: Estimated query execution time (631.63465 seconds) is too long. Maximum: 600. Estimated rows to process: 1000000 (475136 read in 300.11236 seconds).: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_SLOW) (version 24.12.2.20271.altinityantalya (altinity build)) (from [::1]:34080) (comment: 00157_cache_dictionary.sql) (in query: INSERT INTO test.hits_1m SELECT * FROM test.hits LIMIT 1000000 SETTINGS min_insert_block_size_rows = 0, min_insert_block_size_bytes = 0, max_block_size = 8192, max_insert_threads = 1, max_threads = 1, max_parallel_replicas=1;), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, double&, int&&, unsigned long&, unsigned long&, double&) @ 0x00000000112dea84 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:87: DB::ExecutionSpeedLimits::throttle(unsigned long, unsigned long, unsigned long, unsigned long, DB::OverflowMode) const @ 0x00000000112de1ad 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:131: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd669 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:49: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001379e4b7 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:20:45.187408 [ 360 ] {} TCPHandler: Code: 160. DB::Exception: Estimated query execution time (631.63465 seconds) is too long. Maximum: 600. Estimated rows to process: 1000000 (475136 read in 300.11236 seconds).: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_SLOW), Stack trace (when copying this message, always include the lines below): 0. ./build_docker/./src/Common/Exception.cpp:107: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000d78f8db 1. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000867b58c 2. ./src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, double&, int&&, unsigned long&, unsigned long&, double&) @ 0x00000000112dea84 3. ./build_docker/./src/QueryPipeline/ExecutionSpeedLimits.cpp:87: DB::ExecutionSpeedLimits::throttle(unsigned long, unsigned long, unsigned long, unsigned long, DB::OverflowMode) const @ 0x00000000112de1ad 4. ./build_docker/./src/QueryPipeline/ReadProgressCallback.cpp:131: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x00000000112dd669 5. ./build_docker/./src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000137acd66 6. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x000000001379ffe5 7. ./build_docker/./src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001379f376 8. ./build_docker/./src/Processors/Executors/CompletedPipelineExecutor.cpp:49: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x000000001379e4b7 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000d86c242 10. ./contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000d8735fa 11. ? @ 0x00007f294c092ac3 12. ? @ 0x00007f294c124850 2025.04.04 07:23:25.255357 [ 353 ] {} Application: Closed all listening sockets. Waiting for 4 outstanding connections. 2025.04.04 07:23:32.176067 [ 952 ] {} RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled