2025.04.04 20:04:57.135351 [ 359 ] {} Context: Server was built in debug mode. It will work slowly. 2025.04.04 20:04:57.451329 [ 359 ] {} KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper. 2025.04.04 20:04:57.451667 [ 359 ] {} KeeperLogStore: Removing all changelogs 2025.04.04 20:04:57.451860 [ 359 ] {} KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647. 2025.04.04 20:04:57.453971 [ 359 ] {} RaftInstance: invalid election timeout lower bound detected, adjusted to 0 2025.04.04 20:04:57.453982 [ 359 ] {} RaftInstance: invalid election timeout upper bound detected, adjusted to 0 2025.04.04 20:04:57.504354 [ 947 ] {} RaftInstance: Election timeout, initiate leader election 2025.04.04 20:04:57.514085 [ 359 ] {} Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist 2025.04.04 20:04:57.514097 [ 359 ] {} Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/ 2025.04.04 20:04:57.522849 [ 359 ] {} Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl. 2025.04.04 20:04:57.523127 [ 359 ] {} Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production. 2025.04.04 20:04:58.232997 [ 366 ] {dfabfcfa-a188-42bc-8ae9-c961beb721ad} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE hits_v1; to attach existing table or CREATE TABLE hits_v1 ; to create new table or ATTACH TABLE hits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2025.04.04 20:05:08.794967 [ 366 ] {1e66f627-ecdf-4ae5-a74a-73b170f01568} InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE visits_v1; to attach existing table or CREATE TABLE visits_v1
; to create new table or ATTACH TABLE visits_v1 FROM '/path/to/data/'
; to create new table and attach data. 2025.04.04 20:05:45.204656 [ 2030 ] {490761be-f2b8-4494-9c6e-74a5c9a335fd} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:51066) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f66e1a 12. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f60e2a 13. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 14. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f74e68 15. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f609bc 16. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 17. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:4299: DB::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f87289 18. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:5563: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000011f59f05 19. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011f59239 20. /build/src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000011f58b0e 21. /build/src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001261056a 22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x00000000128a57b8 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000128a4289 24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15007]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x00000000128a6c04 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001284ee8b 26. /build/src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8a45c 27. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 28. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 29. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 30. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 2025.04.04 20:05:45.204909 [ 2030 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f66e1a 12. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f60e2a 13. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 14. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f74e68 15. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f609bc 16. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 17. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:4299: DB::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f87289 18. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:5563: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000011f59f05 19. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011f59239 20. /build/src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000011f58b0e 21. /build/src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001261056a 22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x00000000128a57b8 23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000128a4289 24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15007]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x00000000128a6c04 25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001284ee8b 26. /build/src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8a45c 27. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 28. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 29. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 30. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 2025.04.04 20:05:45.224898 [ 2030 ] {b2dbc086-e5a2-4468-813c-e3fcef5fa743} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:51066) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8ac76 12. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 13. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 14. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 15. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 17. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 19. ? @ 0x00007f10f135cac3 20. ? @ 0x00007f10f13ee850 2025.04.04 20:05:45.225083 [ 2030 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8ac76 12. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 13. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 14. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 15. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 17. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 19. ? @ 0x00007f10f135cac3 20. ? @ 0x00007f10f13ee850 2025.04.04 20:05:45.270834 [ 2030 ] {99c7074b-51e5-40b0-ad21-c2154c9a8619} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.79 million: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:51066) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:05:45.271595 [ 2030 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 17.79 million: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:05:45.301886 [ 2030 ] {e3a1c757-3636-41b6-9ef4-4a17bd2855cf} executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:51066) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f66e1a 12. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f60e2a 13. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 14. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f74e68 15. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f609bc 16. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:5588: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000011f5a11a 17. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011f59239 18. /build/src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000011f58b0e 19. /build/src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001261056a 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x00000000128a57b8 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000128a4289 22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15007]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x00000000128a6c04 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001284ee8b 24. /build/src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8a45c 25. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 26. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 27. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 28. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 29. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 30. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 2025.04.04 20:05:45.302140 [ 2030 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.88 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:315: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x00000000148148f5 6. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:2082: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x0000000014828967 7. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector>, std::allocator>>>, DB::BuildQueryPipelineSettings const&) @ 0x00000000147e73cd 8. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001480934b 9. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:261: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x00000000128a66d1 10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:228: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x00000000128a645e 11. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:604: DB::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f66e1a 12. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3854: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f60e2a 13. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3975: DB::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool) @ 0x0000000011f5fb00 14. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:2879: DB::QueryAnalyzer::resolveFunction(std::shared_ptr&, DB::IdentifierResolveScope&) @ 0x0000000011f74e68 15. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:3817: DB::QueryAnalyzer::resolveExpressionNode(std::shared_ptr&, DB::IdentifierResolveScope&, bool, bool, bool) @ 0x0000000011f609bc 16. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:5588: DB::QueryAnalyzer::resolveQuery(std::shared_ptr const&, DB::IdentifierResolveScope&) @ 0x0000000011f5a11a 17. /build/src/Analyzer/Resolve/QueryAnalyzer.cpp:172: DB::QueryAnalyzer::resolve(std::shared_ptr&, std::shared_ptr const&, std::shared_ptr) @ 0x0000000011f59239 18. /build/src/Analyzer/Resolve/QueryAnalysisPass.cpp:18: DB::QueryAnalysisPass::run(std::shared_ptr&, std::shared_ptr) @ 0x0000000011f58b0e 19. /build/src/Analyzer/QueryTreePassManager.cpp:184: DB::QueryTreePassManager::run(std::shared_ptr) @ 0x000000001261056a 20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:149: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr const&, DB::SelectQueryOptions const&, std::shared_ptr const&, std::shared_ptr const&) @ 0x00000000128a57b8 21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:167: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr const&, std::shared_ptr const&, DB::SelectQueryOptions const&, std::vector> const&) @ 0x00000000128a4289 22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if::__unique_single std::make_unique[abi:v15007]&, std::shared_ptr const&, DB::SelectQueryOptions const&>(std::shared_ptr&, std::shared_ptr const&, DB::SelectQueryOptions const&) @ 0x00000000128a6c04 23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001284ee8b 24. /build/src/Interpreters/executeQuery.cpp:1305: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000012b8a45c 25. /build/src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000012b86941 26. /build/src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000014303571 27. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 28. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 29. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 30. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 2025.04.04 20:05:45.312669 [ 2030 ] {c8c321b3-3b22-4217-b078-5825e2b7445d} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:51066) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:05:45.313021 [ 2030 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 10.00 million, current rows: 13.12 million: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.427665 [ 2029 ] {294691b1-0ae1-4467-8c59-cf096d500f84} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50204) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.428810 [ 2029 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.630941 [ 2029 ] {9b95b859-2dd0-42e7-b8f3-db9c17582140} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.69 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50220) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.632613 [ 2029 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.69 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.645125 [ 2043 ] {0b607e5d-5a8d-4f16-a377-fa3a853ffee6} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37360). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.645151 [ 366 ] {b3e936cb-e431-4f6e-8c15-51882cdf7484} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45422). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.645216 [ 2034 ] {6beda004-88ad-4c39-acad-b96c395e2dae} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57254). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.645226 [ 2033 ] {3cfe1900-4871-4b1d-a565-3c2b8abda1e9} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56274). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.645729 [ 366 ] {b3e936cb-e431-4f6e-8c15-51882cdf7484} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45422). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45422) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.645809 [ 2043 ] {0b607e5d-5a8d-4f16-a377-fa3a853ffee6} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37360). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37360) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.645830 [ 2033 ] {3cfe1900-4871-4b1d-a565-3c2b8abda1e9} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56274). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56274) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.645867 [ 2034 ] {6beda004-88ad-4c39-acad-b96c395e2dae} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57254). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57254) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.646599 [ 2043 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37360). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.646632 [ 2033 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56274). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.646857 [ 2034 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57254). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.646925 [ 366 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45422). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.838815 [ 2029 ] {7b7cad8d-73b1-4079-89f8-759bb74f000f} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50230) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.839647 [ 2043 ] {2657155f-5b22-4e85-a7c0-2cf4778807bf} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59054). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.839936 [ 1800 ] {6dcd45bc-5b24-4bd2-86ee-d502e8733392} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37370). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.840096 [ 2043 ] {2657155f-5b22-4e85-a7c0-2cf4778807bf} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59054). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59054) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.840301 [ 366 ] {8b2f8eb0-9d05-4576-a055-f2472ee28ea5} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57260). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.840440 [ 2034 ] {6525a8c4-db37-48bc-b6fb-7a3605847117} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56276). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.840538 [ 1800 ] {6dcd45bc-5b24-4bd2-86ee-d502e8733392} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37370). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37370) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.840576 [ 2043 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59054). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.840774 [ 2029 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.840789 [ 366 ] {8b2f8eb0-9d05-4576-a055-f2472ee28ea5} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57260). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57260) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.840884 [ 2034 ] {6525a8c4-db37-48bc-b6fb-7a3605847117} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56276). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56276) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.841172 [ 366 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57260). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.841391 [ 1800 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37370). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.841406 [ 2034 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56276). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:26.850947 [ 2033 ] {} TCPHandler: TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket (peer: [::ffff:127.0.0.1]:45432, local: [::ffff:127.0.0.3]:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/ReadBufferFromPocoSocket.cpp:83: DB::ReadBufferFromPocoSocketBase::socketReceiveBytesImpl(char*, unsigned long) @ 0x000000000ce9b8ee 4. /build/src/IO/ReadBufferFromPocoSocket.cpp:107: DB::ReadBufferFromPocoSocketBase::nextImpl() @ 0x000000000ce9be23 5. /build/src/IO/ReadBuffer.h:67: DB::ReadBuffer::next() @ 0x000000000765929b 6. /build/src/IO/ReadBuffer.h:103: DB::TCPHandler::runImpl() @ 0x0000000014302b7e 7. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 8. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 9. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 10. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 11. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 12. ? @ 0x00007f10f135cac3 13. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:26.851016 [ 2033 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket (peer: [::ffff:127.0.0.1]:45432, local: [::ffff:127.0.0.3]:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/ReadBufferFromPocoSocket.cpp:83: DB::ReadBufferFromPocoSocketBase::socketReceiveBytesImpl(char*, unsigned long) @ 0x000000000ce9b8ee 4. /build/src/IO/ReadBufferFromPocoSocket.cpp:107: DB::ReadBufferFromPocoSocketBase::nextImpl() @ 0x000000000ce9be23 5. /build/src/IO/ReadBuffer.h:67: DB::ReadBuffer::next() @ 0x000000000765929b 6. /build/src/IO/ReadBuffer.h:103: DB::TCPHandler::runImpl() @ 0x0000000014302b7e 7. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 8. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 9. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 10. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 11. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 12. ? @ 0x00007f10f135cac3 13. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.073853 [ 1864 ] {a01287c0-98b5-46af-ae3e-c73ecef202ea} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50234) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.074984 [ 2029 ] {7c43308b-2e12-479e-96ff-8fc78bafcd37} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45014). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.075185 [ 366 ] {a0afbbe8-00a9-4296-b8e6-0d937da810bb} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59066). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.075372 [ 2034 ] {3089efd9-3a2f-4d03-9ae8-ade49dca4555} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37374). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.075466 [ 2029 ] {7c43308b-2e12-479e-96ff-8fc78bafcd37} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45014). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45014) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.075631 [ 2032 ] {} TCPHandler: TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket (peer: [::ffff:127.0.0.1]:45444, local: [::ffff:127.0.0.3]:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/ReadBufferFromPocoSocket.cpp:83: DB::ReadBufferFromPocoSocketBase::socketReceiveBytesImpl(char*, unsigned long) @ 0x000000000ce9b8ee 4. /build/src/IO/ReadBufferFromPocoSocket.cpp:107: DB::ReadBufferFromPocoSocketBase::nextImpl() @ 0x000000000ce9be23 5. /build/src/IO/ReadBuffer.h:67: DB::ReadBuffer::next() @ 0x000000000765929b 6. /build/src/IO/ReadBuffer.h:103: DB::TCPHandler::runImpl() @ 0x0000000014302b7e 7. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 8. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 9. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 10. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 11. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 12. ? @ 0x00007f10f135cac3 13. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.075649 [ 366 ] {a0afbbe8-00a9-4296-b8e6-0d937da810bb} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59066). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59066) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.075692 [ 2032 ] {} ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket (peer: [::ffff:127.0.0.1]:45444, local: [::ffff:127.0.0.3]:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/ReadBufferFromPocoSocket.cpp:83: DB::ReadBufferFromPocoSocketBase::socketReceiveBytesImpl(char*, unsigned long) @ 0x000000000ce9b8ee 4. /build/src/IO/ReadBufferFromPocoSocket.cpp:107: DB::ReadBufferFromPocoSocketBase::nextImpl() @ 0x000000000ce9be23 5. /build/src/IO/ReadBuffer.h:67: DB::ReadBuffer::next() @ 0x000000000765929b 6. /build/src/IO/ReadBuffer.h:103: DB::TCPHandler::runImpl() @ 0x0000000014302b7e 7. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 8. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 9. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 10. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 11. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 12. ? @ 0x00007f10f135cac3 13. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.075883 [ 2029 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45014). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.075882 [ 2034 ] {3089efd9-3a2f-4d03-9ae8-ade49dca4555} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37374). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37374) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.075957 [ 1801 ] {6d41aa9e-0d02-49d8-b771-0e0ce11873da} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57266). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.076053 [ 366 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59066). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.076400 [ 2030 ] {b787c378-c9e9-45ec-8ec6-a16c35e3180a} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.076458 [ 1801 ] {6d41aa9e-0d02-49d8-b771-0e0ce11873da} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57266). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57266) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.076538 [ 1864 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.66 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.076658 [ 2034 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37374). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.076892 [ 2030 ] {b787c378-c9e9-45ec-8ec6-a16c35e3180a} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56292). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56292) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.076939 [ 1801 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57266). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.077153 [ 2030 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.270183 [ 2033 ] {7a8f07d4-f634-4968-8a24-ac836019a092} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50250) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.270974 [ 2032 ] {82db675a-65cf-403d-8864-00b284310d6c} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59082). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.271239 [ 1864 ] {fea04b7b-77cb-4145-9c03-db67cf661df0} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37388). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.271365 [ 367 ] {cb1fc1d5-e5d8-4e47-a731-3e3a52784931} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45458). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.271772 [ 2032 ] {82db675a-65cf-403d-8864-00b284310d6c} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59082). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59082) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.271814 [ 1864 ] {fea04b7b-77cb-4145-9c03-db67cf661df0} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37388). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37388) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.271826 [ 367 ] {cb1fc1d5-e5d8-4e47-a731-3e3a52784931} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45458). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45458) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.272057 [ 2033 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.272112 [ 2028 ] {71b09d0d-056b-44e5-8cfe-7a9dbdbb2d43} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57282). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.272825 [ 2032 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59082). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.272910 [ 1864 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37388). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.272927 [ 367 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45458). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.273202 [ 2028 ] {71b09d0d-056b-44e5-8cfe-7a9dbdbb2d43} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57282). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57282) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.274147 [ 2028 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57282). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.285420 [ 1801 ] {8ab3a37b-29ff-485b-b4f8-02d470e5f736} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59964). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59964) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2564: DB::TCPHandler::sendProgress(DB::QueryState&) @ 0x000000001430e45c 6. /build/src/Server/TCPHandler.cpp:1251: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de3f 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.286349 [ 1801 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59964). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2564: DB::TCPHandler::sendProgress(DB::QueryState&) @ 0x000000001430e45c 6. /build/src/Server/TCPHandler.cpp:1251: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de3f 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.298072 [ 1800 ] {76bedd54-e2cc-4c1d-99d6-b65650af0d0f} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56302). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.298640 [ 1800 ] {76bedd54-e2cc-4c1d-99d6-b65650af0d0f} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56302). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56302) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.300275 [ 1800 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56302). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.327739 [ 2030 ] {d75a136e-e700-4857-aba5-6d4e87419a45} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45026). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.328211 [ 2030 ] {d75a136e-e700-4857-aba5-6d4e87419a45} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45026). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45026) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.329750 [ 2030 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45026). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.500353 [ 2033 ] {0695a758-603f-4365-b1f0-fb6f840daa20} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.67 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50262) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.500838 [ 2029 ] {0ff0aea8-bc26-4208-9149-d403f9a866f3} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42128). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.501193 [ 1864 ] {118b482c-d885-44be-9e8b-7ef07ffaf486} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59090). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.501484 [ 2030 ] {1bea91fc-f71f-417e-830e-db561583a18c} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37394). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.501672 [ 1800 ] {242c7c2c-96dd-45da-abdd-e4f93a97d631} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.501714 [ 2029 ] {0ff0aea8-bc26-4208-9149-d403f9a866f3} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42128). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:42128) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.501731 [ 1864 ] {118b482c-d885-44be-9e8b-7ef07ffaf486} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59090). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59090) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.501924 [ 2030 ] {1bea91fc-f71f-417e-830e-db561583a18c} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37394). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37394) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.502088 [ 1800 ] {242c7c2c-96dd-45da-abdd-e4f93a97d631} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57292). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57292) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.502161 [ 2033 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.67 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.502222 [ 367 ] {2007e523-0421-4093-89e6-40b515a17973} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56308). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.502597 [ 1864 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59090). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.502649 [ 367 ] {2007e523-0421-4093-89e6-40b515a17973} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56308). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56308) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.502727 [ 2029 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42128). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.503069 [ 2030 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37394). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.503571 [ 2032 ] {c679cf1b-681e-466f-b31d-f803956aded1} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45038). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.503697 [ 367 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56308). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.503845 [ 1800 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57292). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.504077 [ 2032 ] {c679cf1b-681e-466f-b31d-f803956aded1} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45038). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45038) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.505469 [ 2032 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45038). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.507741 [ 2028 ] {316510a5-05ca-4c31-beab-b8839ac6507f} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45470). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.508160 [ 2028 ] {316510a5-05ca-4c31-beab-b8839ac6507f} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45470). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45470) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.510026 [ 2028 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45470). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.521856 [ 1801 ] {cf16f0ce-0a1a-4305-badb-30fcbd6d4b74} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59976). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.522287 [ 1801 ] {cf16f0ce-0a1a-4305-badb-30fcbd6d4b74} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59976). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59976) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.523631 [ 1801 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59976). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.699992 [ 1801 ] {d8e8d4e6-5cc2-40b9-b23b-a2bb175593cc} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50270) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.701074 [ 2034 ] {df24fa98-d38a-4111-b377-53608a42d2eb} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59986). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.701477 [ 1864 ] {947a6525-59f2-47e7-ad61-924207bd5d62} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45046). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.702518 [ 2034 ] {df24fa98-d38a-4111-b377-53608a42d2eb} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59986). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59986) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.702726 [ 1864 ] {947a6525-59f2-47e7-ad61-924207bd5d62} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45046). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45046) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.703804 [ 1968 ] {907fc98a-509e-4cc1-b07f-fd9f407a462f} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45484). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.703997 [ 2034 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59986). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.704226 [ 1968 ] {907fc98a-509e-4cc1-b07f-fd9f407a462f} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45484). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45484) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.704529 [ 1864 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45046). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.704722 [ 367 ] {35becf0f-e4ad-4987-ac30-f8afc9c046fc} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56312). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.704996 [ 1968 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45484). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.705156 [ 1801 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.707391 [ 367 ] {35becf0f-e4ad-4987-ac30-f8afc9c046fc} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56312). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56312) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.708548 [ 367 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56312). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.717533 [ 2032 ] {3af05911-a87b-4620-9cbd-721835611331} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59096). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.717973 [ 2032 ] {3af05911-a87b-4620-9cbd-721835611331} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59096). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59096) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.719109 [ 2032 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59096). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.722709 [ 2033 ] {8bfe235b-41b0-47e0-8da9-3a76bfd408f2} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42138). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.723150 [ 2033 ] {8bfe235b-41b0-47e0-8da9-3a76bfd408f2} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42138). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:42138) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.724416 [ 2033 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42138). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.731051 [ 2029 ] {cc1c00fe-8d95-4c92-ad80-b4d3da1cecce} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50396). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.737604 [ 2029 ] {cc1c00fe-8d95-4c92-ad80-b4d3da1cecce} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50396). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50396) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.738701 [ 2029 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50396). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.743481 [ 2028 ] {6fec6919-f8ee-45d0-9bd3-1d9022e7742b} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57302). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.743919 [ 2028 ] {6fec6919-f8ee-45d0-9bd3-1d9022e7742b} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57302). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57302) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.745553 [ 2028 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57302). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.758521 [ 2030 ] {21036035-a7fa-4667-8709-1e3612d92bbc} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37400). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.759084 [ 2030 ] {21036035-a7fa-4667-8709-1e3612d92bbc} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37400). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37400) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.761336 [ 2030 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37400). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.919259 [ 2043 ] {287576cd-c0be-4ee4-82bf-242a8297d4d0} executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:50282) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT SearchPhrase AS k, count() AS c FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) GROUP BY k ORDER BY c DESC LIMIT 10), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.920218 [ 2033 ] {ca82f377-5f6c-471f-8e6a-846b02250a02} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42140). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.920264 [ 2030 ] {a3b4bc6b-0787-4f1f-a111-f6e19f1e7ed4} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45054). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.920348 [ 2029 ] {2518f43c-1c12-40b4-9f86-da28027a7441} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59112). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.920731 [ 2030 ] {a3b4bc6b-0787-4f1f-a111-f6e19f1e7ed4} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45054). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45054) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.920770 [ 2034 ] {16b876af-5fb5-41f2-a0bc-bbb3672e4c69} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:36466). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.920785 [ 2029 ] {2518f43c-1c12-40b4-9f86-da28027a7441} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59112). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59112) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.920857 [ 2028 ] {097a66ff-9dc9-417e-a386-f7e169a2833f} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57318). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.921463 [ 2032 ] {3e5b5387-b2f3-49b0-b1a8-1a29246e59cf} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.921647 [ 2029 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.5]:9000 -> [::ffff:127.0.0.1]:59112). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.921720 [ 2034 ] {16b876af-5fb5-41f2-a0bc-bbb3672e4c69} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:36466). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:36466) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.921836 [ 2028 ] {097a66ff-9dc9-417e-a386-f7e169a2833f} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57318). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:57318) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.921870 [ 2030 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.6]:9000 -> [::ffff:127.0.0.1]:45054). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.922458 [ 2034 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.10]:9000 -> [::ffff:127.0.0.1]:36466). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.922582 [ 2043 ] {} TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 20.00 million, current rows: 26.64 million: While executing Remote. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, String&&, String&&) @ 0x0000000011b1804b 4. /build/src/QueryPipeline/SizeLimits.cpp:32: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b179f2 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.922870 [ 2032 ] {3e5b5387-b2f3-49b0-b1a8-1a29246e59cf} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59992). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:59992) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.923035 [ 2028 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:57318). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.923937 [ 2032 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.7]:9000 -> [::ffff:127.0.0.1]:59992). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.926515 [ 2033 ] {ca82f377-5f6c-471f-8e6a-846b02250a02} executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42140). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:42140) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.927881 [ 2033 ] {} TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.8]:9000 -> [::ffff:127.0.0.1]:42140). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:160: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d751 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.931970 [ 1801 ] {37c798a8-e24e-4ba7-8836-1b7a021fe695} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50406). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.932425 [ 1801 ] {37c798a8-e24e-4ba7-8836-1b7a021fe695} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50406). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:50406) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.933562 [ 1801 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.9]:9000 -> [::ffff:127.0.0.1]:50406). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.941292 [ 1864 ] {cd7d0ef3-b3a3-4461-a1d8-c46b289a26b3} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37408). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.941727 [ 1864 ] {cd7d0ef3-b3a3-4461-a1d8-c46b289a26b3} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37408). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:37408) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.942947 [ 1864 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:37408). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.948254 [ 1968 ] {635b94b5-7db8-4137-abff-aa82fc572860} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56316). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.948688 [ 1968 ] {635b94b5-7db8-4137-abff-aa82fc572860} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56316). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:56316) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.950130 [ 1968 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:56316). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.959808 [ 367 ] {bbb92c5d-ff68-42dc-9180-feeb4384aa76} void DB::TCPHandler::sendData(QueryState &, const Block &): Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45500). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:27.960198 [ 367 ] {bbb92c5d-ff68-42dc-9180-feeb4384aa76} executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45500). (NETWORK_ERROR) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::ffff:127.0.0.1]:45500) (comment: 00090_thread_pool_deadlock.sh) (in query: SELECT `__table1`.`SearchPhrase` AS `k`, count() AS `c` FROM `test`.`hits` AS `__table1` GROUP BY `__table1`.`SearchPhrase` ORDER BY count() DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:27.961875 [ 367 ] {} TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.3]:9000 -> [::ffff:127.0.0.1]:45500). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String&&, String&&) @ 0x000000000ce9c35f 3. /build/src/IO/WriteBufferFromPocoSocket.cpp:171: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000ce9d907 4. /build/src/IO/WriteBuffer.h:65: DB::WriteBuffer::next() @ 0x000000000758897e 5. /build/src/Server/TCPHandler.cpp:2464: DB::TCPHandler::sendData(DB::QueryState&, DB::Block const&) @ 0x000000001431633b 6. /build/src/Server/TCPHandler.cpp:1260: DB::TCPHandler::processOrdinaryQuery(DB::QueryState&) @ 0x000000001430de8d 7. /build/src/Server/TCPHandler.cpp:670: DB::TCPHandler::runImpl() @ 0x00000000143036b6 8. /build/src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001431a679 9. /build/base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000017f9c887 10. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000017f9cd5e 11. /build/base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000017f48af2 12. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000017f467e3 13. ? @ 0x00007f10f135cac3 14. ? @ 0x00007f10f13ee850 2025.04.04 20:06:29.042088 [ 978 ] {aaf91467-ead0-48ff-baff-f794d37ab2d3::all_1_6_1} virtual bool DB::MergePlainMergeTreeTask::executeStep(): Exception is in merge_task.: Code: 236. DB::Exception: Cancelled merging parts. (ABORTED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000757f44b 4. /build/src/Storages/MergeTree/MergeTask.cpp:263: DB::MergeTask::GlobalRuntimeContext::checkOperationIsNotCanceled() const @ 0x0000000013d2a4ba 5. /build/src/Storages/MergeTree/MergeTask.cpp:931: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::finalize() const @ 0x0000000013d36d1c 6. /build/src/Storages/MergeTree/MergeTask.cpp:892: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() const @ 0x0000000013d36ac8 7. /build/src/Storages/MergeTree/MergeTask.cpp:720: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000013d34ff9 8. /build/src/Storages/MergeTree/MergeTask.cpp:1504: DB::MergeTask::execute() @ 0x0000000013d3b56a 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x00000000140ce2a4 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:308: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000013d5c54e 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:353: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000013d5ce51 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 16. ? @ 0x00007f10f135cac3 17. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:30.966381 [ 987 ] {102e78e5-4dcc-44fa-a211-057618d3ced7::all_1_7_1} virtual bool DB::MergePlainMergeTreeTask::executeStep(): Exception is in merge_task.: Code: 236. DB::Exception: Cancelled merging parts. (ABORTED), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000757f44b 4. /build/src/Storages/MergeTree/MergeTask.cpp:263: DB::MergeTask::GlobalRuntimeContext::checkOperationIsNotCanceled() const @ 0x0000000013d2a4ba 5. /build/src/Storages/MergeTree/MergeTask.cpp:931: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::finalize() const @ 0x0000000013d36d1c 6. /build/src/Storages/MergeTree/MergeTask.cpp:892: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::executeImpl() const @ 0x0000000013d36ac8 7. /build/src/Storages/MergeTree/MergeTask.cpp:720: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::execute() @ 0x0000000013d34ff9 8. /build/src/Storages/MergeTree/MergeTask.cpp:1504: DB::MergeTask::execute() @ 0x0000000013d3b56a 9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x00000000140ce2a4 10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:308: DB::MergeTreeBackgroundExecutor::routine(std::shared_ptr) @ 0x0000000013d5c54e 11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:353: DB::MergeTreeBackgroundExecutor::threadFunction() @ 0x0000000013d5ce51 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 16. ? @ 0x00007f10f135cac3 17. ? @ 0x00007f10f13ee850 (version 24.12.2.20230.altinityantalya (altinity build)) 2025.04.04 20:06:34.744881 [ 2028 ] {f3b54912-770e-4cff-893f-b179d8f9e612} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.95 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:37220) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:34.745790 [ 2028 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 572.95 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:34.926069 [ 2028 ] {6da5561f-accb-4e13-8e20-ed059a4dbb08} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 573.90 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:37220) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:34.926958 [ 2028 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 573.90 MiB: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:35.091032 [ 2028 ] {513860bb-44c1-4400-b52a-e48306352b72} executeQuery: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 573.86 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:37220) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits PREWHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND URL != '' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00';), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:06:35.091592 [ 2028 ] {} TCPHandler: Code: 307. DB::Exception: Limit for rows or bytes to read exceeded, max bytes: 572.20 MiB, current bytes: 573.86 MiB: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_MANY_BYTES), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, char const*&, ReadableSize&&, ReadableSize&&) @ 0x0000000011b1812b 4. /build/src/QueryPipeline/SizeLimits.cpp:43: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000011b17ae1 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af109a 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:404: void std::__function::__policy_invoker::__call_impl>(std::__function::__policy_storage const*) @ 0x00000000143bb63f 10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce14fb3 11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce1a362 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:13:56.774213 [ 3666 ] {e0b2fb7d-6f20-4ae3-9553-4fa23273c317} executeQuery: Code: 160. DB::Exception: Estimated query execution time (1029.17362 seconds) is too long. Maximum: 600. Estimated rows to process: 1000000 (335872 read in 345.67060 seconds).: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_SLOW) (version 24.12.2.20230.altinityantalya (altinity build)) (from [::1]:52258) (comment: 00157_cache_dictionary.sql) (in query: INSERT INTO test.hits_1m SELECT * FROM test.hits LIMIT 1000000 SETTINGS min_insert_block_size_rows = 0, min_insert_block_size_bytes = 0, max_block_size = 8192, max_insert_threads = 1, max_threads = 1, max_parallel_replicas=1;), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, double&, int&&, unsigned long&, unsigned long&, double&) @ 0x0000000011af1cd9 4. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:87: DB::ExecutionSpeedLimits::throttle(unsigned long, unsigned long, unsigned long, unsigned long, DB::OverflowMode) const @ 0x0000000011af19af 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:131: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af1139 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:442: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x00000000143b948c 10. /build/src/Processors/Executors/PipelineExecutor.cpp:127: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000143b8e8f 11. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000143b8287 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:13:56.805836 [ 3666 ] {} TCPHandler: Code: 160. DB::Exception: Estimated query execution time (1029.17362 seconds) is too long. Maximum: 600. Estimated rows to process: 1000000 (335872 read in 345.67060 seconds).: While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (TOO_SLOW), Stack trace (when copying this message, always include the lines below): 0. /build/contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000017ef67f2 1. /build/src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000cd55af9 2. /build/src/Common/Exception.h:105: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000757c4ec 3. /build/src/Common/Exception.h:123: DB::Exception::Exception(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type, std::type_identity::type, std::type_identity::type>, double&, int&&, unsigned long&, unsigned long&, double&) @ 0x0000000011af1cd9 4. /build/src/QueryPipeline/ExecutionSpeedLimits.cpp:87: DB::ExecutionSpeedLimits::throttle(unsigned long, unsigned long, unsigned long, unsigned long, DB::OverflowMode) const @ 0x0000000011af19af 5. /build/src/QueryPipeline/ReadProgressCallback.cpp:131: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list> const&) @ 0x0000000011af1139 6. /build/src/Processors/Executors/ExecutionThreadContext.cpp:64: DB::ExecutionThreadContext::executeTask() @ 0x00000000143c59e3 7. /build/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic*) @ 0x00000000143ba970 8. /build/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x00000000143bac3e 9. /build/src/Processors/Executors/PipelineExecutor.cpp:442: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x00000000143b948c 10. /build/src/Processors/Executors/PipelineExecutor.cpp:127: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x00000000143b8e8f 11. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: void std::__function::__policy_invoker::__call_impl::ThreadFromGlobalPoolImpl(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'(), void ()>>(std::__function::__policy_storage const*) @ 0x00000000143b8287 12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000000ce12ac0 13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ? @ 0x000000000ce183d2 14. ? @ 0x00007f10f135cac3 15. ? @ 0x00007f10f13ee850 2025.04.04 20:14:01.624637 [ 359 ] {} Application: Closed all listening sockets. Waiting for 4 outstanding connections. 2025.04.04 20:14:06.530189 [ 359 ] {} Application: Closed connections. But 4 remain. Tip: To increase wait time add to config: 60 2025.04.04 20:14:09.920745 [ 359 ] {} Application: Will shutdown forcefully.